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RESULTS INDICATE THAT IT IS PRACTICAL TO EXPECT TEACHERS TO 
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classification ability was FOUND RELATED TO ACHIEVEMENT IN 
SUCH SEEMINGLY DIVERSE SUBJECT MATTERS AS MATHEMATICS AND 
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STRUCTURE OF INTELLECT IN THE PROFESSIONAL EDUCATION OF 
TEACHERS BOTH AS A DESCRIPTION OF INTELLECT AND AS A TAXONOMY 
OF EDUCATIONAL OBJECTIVES, AT LEAST FOR THE FACETS OF THE 
MODEL INVESTIGATED IN THIS STUDY. (IM) 
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INTRODUCTION 



Problem 



To be Involved In the professional preparation of teachers Is to be haunt- 
ed by the question— does the Instruction that the potential teacher receives In 
my class Influence significantly the kind of teacher he will eventually become? 
One finding about learning that Is supported by research, regardless of the prob- 
lem Investigated or the theoretical stance of the Investigator, Is that— If some- 
thing which has been learned Is to transfer. Is to be resistant to forgetting and 
extinction. Is to generalize. It must be thoroughly learned. Its applicability to 
a wide range of problems must be demonstrated and Its generallsablllty stressed. 

In view of these realities, the teacher of teachers must select with great care 
the content to be emphasized In his Instruction. Having done so, he must plan 
experiences for his students which are most apt to result In such thorough learn- 
ing. 



At California State College at Fullerton, the responsibility for teaching 
the potential teacher about cognition and Intelligence has been assigned to a 
course entitled. Psychological Foundations of Education. Each Instructor of 
this class must select or devise a theory that seems to him to be potentially 
of most value to teachers— a theory regarding cognition and Intelligence which. 

If thoroughly understood by the potential teacher. Is most apt to Influence the 
way he will eventually teach. Before considering the question of which theory 
Is the most promising, a prior question Is In order — of what use to teachers Is 
knowledge about Intelligence? Our answer to the question Is that the teacher 
should understand Intelligence so that he will be able to help the children or 
youth he teaches to respect, value and take pride In enhancing their own Intel- 
ligence. If teachers lack the understanding and skill necessary to help child- 
ren demonstrate their Intelligence, the tragic result may be distrust and rejec- 
tion by some children both of the schools and of their own Intellect. 

Typical classroom Instruction relies heavily on memory of factual verbal 
material— on the ability of the pupil to remember Information that has been pre- 
sented In much the same form and In connection with the same contextual cues 
with which It was learned. The teacher knows very well how to elicit, recognize 
and reinforce evidence of Intelligence when It Is thus defined. Classroom Instruc- 
tion relies heavily, also, on the ability to follow prescribed procedures and to 
come up with correct answers. Children who possess the kinds of Intelligence 
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and the motivation which permits them to go through these procedures and pro- 
duce these correct answers will have many success experiences In school. Many 
children and youth, however, are unable or unwilling to demonstrate Intelligent 
behavior when Intelligence Is thus narrowly defined. All teachers know about 
Individual differences In Intelligence, but few know what to do about It. More 
devastating Is the fact that the teachers of teachers seem to be able to help 
them very little. We have suggested that the teacher should understand Intel- 
ligence so that he will be able to cultivate It. According to reinforcement 
theory, he can foster It best by eliciting Intelligent behavior or by recognizing 
emitted Intelligent behavior and by reinforcing It. The emphasis on Intelligence 
In our Instruction of potential teachers Is aimed at helping them discover ways 
to elicit Intelligent behavior from all of their students and to recognize Intel- 
ligent behavior when they see It. With this as our goal, the definition of Intel- 
ligence we use must be Inclusive, detailed and specific. 

It Is, of course, true that there exists no established definition or des- 
cription of Intelligence upon which all authorities can agree. The teacher can- 
not wait for the scientific establishment of "the whole truth" concerning the 
structure and function of the human nervous system. Rather, he must use the most 
promising theory he can find or devise and exploit It to the fullest, while 
realizing that It Is tentative and Imperfect. The test of a theory rests with 
the extent to which It Is compatible with accumulated knowledge and the extent 
to which It stimulates further research and exploration. J. P. Guilford's 
Structure of Intellect model meets both of these tests and. In addition, meets 
a third which Is Indispensable If a theory Is to be useful to teachers — parsimony. 

An understanding of the Structure of Intellect tests on the grasp of only fifteen 
terms. True, these fifteen concepts become useful as operational definitions 
only after considerable analysis and application, but the typical teacher-educa- 
tion student in his junior or senior year of college can acquire a working knowl- 
edge of the model within the span of a single semester. 

J. P. Guilford's model which he calls Structure of Intellect and which was 
described In relatively non-technlcal terms In an article published In the 
American Psychologist . 1959, 14, 469-479 under the title "Three Faces of Intellect," 
Is the theoretical basis for the study. The model of Intellect hypothesized des- 
cribes all Intellectual acts as representing one of four kinds of content — 
figural, symbolic, semantic or behavioral; one of the fiva operations- — cognition, 
memory, divergent production, convergent production, and evaluation; and one of 
six products — units, classes, relations, systems, transformations, and implica- 
tions. According to the theory, any Intellectual task a person performs can be 
seen as representing one of the four kinds of content, one of the five operations, 
and one of the six products. Guilford and his associates are attempting to test 
the hypothesis through the use of factor analysis that Intelligence is made up 
of 120 distinct abilities, each represented by the point In the model where the 
three faces Intersect. Their work, then consists of trying to discover ways of 
Isolating and measuring these 120 kinds of mental ability. Figure 1, on page 
3, gives a graphic representation of the model. 



FIGURE I 




Psychologists have not given the model their unqualified endorsement. It 
is much too soon to say whether future work by Guilford and his associates will 
be able to satisfactorily answer the criticisms now directed toward the model. 
Even though its validity as a model of intelligence has not been and may never 
be established, its usefulness to the teacher and to the teacher of teachers Is 
substantial. The prospective teacher in his training is Introduced to subject 
matter Intended to help him understand the nature of intelligence and its meas- 
urement. He Is also Introduced to teaching methodology, but rarely is he helped 
to see the relationship among the nature of Intellect, the nature of academic 
subject matter and the nature of teaching methodology. This state of affairs 
exists, we suspect, because definitions of Intelligence heretofore have not lent 
themselves readily to the demonstration of such relationships. The Structure of 
Intellect presents intelligence as a number of discrete abilities which, when 
combined in various ways, are readily translatable into subject matter as it Is 
taught in the public schools. In short, the Structure of Intellect seems to have 
great promise as a tool for helping teachers: (1) to be able to describe the 
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Intellectual capacities a learner must utilize in order to "learn" various 
subject matters; (2) to set goals and objectives which give students experiences 
in utilizing appropriately as much of their Intellectual potential as possible 
in dealing with each phase of the curriculum; and (3) to design classroom activi- 
ties and teaching aids appropriate to Intellectual development ^s broadly con- 
ceived, as well as the mastery of subject matter. 

Generally speaking, college students who study the Structure of Intellect 
find it stimulating. They share their instructor’s enthusiasm for it as a sort 
of taxonomy of educational objectives. They participate extensively in design- 
ing instructional materials and exercises purporting to elicit the kinds of 
thinking the model Incorporates. 

It is fairly safe to assume that many students who are Introduced to the 
Structure of Intellect in this way Intend— —sometime in the future when they 
become teachers— to try to teach in a manner that will stimulate their pupils 
to use all of the facets of intelligence hypothesized by the model. 

Strangely, confidence that one has accomplished this much through instruc- 
tion rather than allaying the anxieties of the teacher of teachers, multiplies 
these anxieties. 

Now a host of potential problems become very real. The nature of the 
questions change from "Can the student who teaches history, for example, re- 
cast the subject matter of his discipline which is usually presented in a nar- 
rative fashion in books and films, into classroom exercises which call for clas- 
sifying, seeing relationships, systematizing, etc.? to When the teacher 
devises exercises calling upon his pupils to classify, see relationships and to 
systematize, will his history pupils or his third graders be able to perform 
as predicted? And, if the teacher does re-cast his subject matter in these ways, 
will he really be stimulating a kind of Intellectual behavior which is of more 
value to the pupils than the relatively straight-forward traditional question 
and answer techniques with which the teacher’s own intelligence was nourished? 

These are the kinds of concerns that led up to the study described in this 
report— e study to determine whether college students in a teacher-education 
program can devise techniques and exercises which will stimulate eighth grade 
subjects to classify information utlll^^ing the five operations hypothesized by 
the Structure of Intellect model. 

The Structure of Intellect postulates six products— units , classes, rela- 
tions, systems, transformations, and implications— any of which could have been 
selected as a starting point for a series of studies purporting to test the 
practicality of using the Structure of Intellect as a taxonomy of education 

objectives. 

The nroduct classes (the ability to classify) was selected for this initial 
study, in part at least, because exercises calling upon learners to classify 
information in the classroom, using any but the operation of memory, are apparent- 
ly rare. 

To summarize, the problem for this study is to gather data with which to 
test some of the assumptions on which our use of the Structure of Intellect in 
the professional education of teachers is based. 
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Obi active! 

The objectives of this study ere to gather data with which to assess the 
soundness of the practice of using the Structure of Intellect as a taxonomy 
of educational objectives In the professional preparation of teachers. Data 
will be gathered which are seen as relevant to the following premises 1 

1. That eighth grade subjects have many concepts learned through out-of~ 
school experiences which could be need to make classroom Instruction 
more meaningful and personal, and that an Inventory of such words and 
concepts may be obtained quickly by a teacher using Divergent Produc- 
tion of Units techniques. 

2. That, using words and concepts suggested by the subjects themselves, 
college students (and therefore, practicing teachers) can devise 
exercises which are consistent with the Intellectual abilities hypo- 
thesized by the Structure of Intellect and which are within the capa- 
bilities of the pupils. 

3. That a systematic examination of the manner In which eighth graders 
respond to such teacher-made exercises will contribute In meaningful 
ways toward an understanding of the hypothesized Intellectual ability, 
of the pupils as individuals, and of the technique designed to elicit 
the behavior. 

4. That the abilities tapped through the use of teacher-made Instruments 
designed to tap Intellectual abilities will be found to be related to 
school achievement In ways which are Interpre table. 

5. That, abilities described by the Structure of Intellect as relatively 
Independent will be found to be relatively Independent even when the 
method of eliciting the behavior is modified as It may become in the 
hands of a teacher using the exercises to promote rather than measure 
Intelligence. 



Procedure 



Data for the study were gathered from the pupils in two sections of eighth 
grade English meeting In their regular classrooms and during regular class time 
on five successive Thursday mornings In the late spring of 1966. During the 
first of these sessions, answer sheets were distributed, and the subjects were 
requested to write all of the words which were suggested to them by the topic 
word LAW. They were discouraged from stream-of-consclousness association by 
instructions to "write only those words that the word LAW makes you think of." 

At the end of the first data gathering session, the answer sheets were collected 
from all subjects. An alphabetized list of all the different words produced 
by the members of both English classes was prepared by the pi\^jeet staff. This 
master list of over 400 words was duplicated and distributed to college students 
in their college class. Psychological Foundations of Education, on the follslrlng 
day. 
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Using these basic lists of words, and formats suggested by the investiga- 
tor as being consistent with the Structure of Intellect definition, the college 
students designed the classification items which were then administered to the 
eighth grade subjects in four additional data gathering sessions. By way of 
illustration, in the week between the first data gathering session and the 
second, the college students designed items purporting to elicit Convergent 
Production of Classes and Memory of Classes responses. Then, in the week between 
the second and the third data gathering sessions the college students designed 
additional items for Convergent Production of Classes and so forth. From among 
the large quantity of items prepared by the college students, the project staff 
selected items and prepared the instruments. Insofar as the time available 
permitted, the items were edited and refined. An attempt was made to select 
items for Inclusion in the Instruments which utilized a wide variety of con- 
cepts and would be challenging to the subjects. 

Following is a time-table which describes the sequences in which the clas- 
sification tasks were administered to the subjects. 

First Data Gathering Session - DIVERGENT PRODUCTION OF UNITS: 

Writing words associated to the stimulus 
word LAW. 

DIVERGENT PRODUCTION OF CLASSES: 

Subjects classified words in any way they 
saw fit, using words from their own lists, 
any of the 100 words written on the chalk 
board, and any other words they could think 
of that could be used to produce three-word 
classes. 

Second Data Gathering Session -CONVERGENT PRODUCTION OF CLASSES INSTRUMENT 

PART I. 

Instruction for the Memory of Jlasses task. 

Third Data Gathering Session - MEMORY OF CLASSES INSTRUMENT. 

CONVERGENT PRODUCTION OF CLASSES INSTRUMENT 
PART II. 

Fourth Data Gathering Session -COGNITION OF CLASSES INSTRUMENT. 

Fifth Data Gathering Session - EVALUATION OF CLASSES INSTRUMENT AND 

INTERVIEWS . 

Fifty-four eighth grade subjects completed all phases of data gathering. 

A cumulative record sheet was prepared for each of the fifty-four subjects. 
Information including teachers grades for seventh and eighth grades in all •sub- 
jects, scores on the California Test of Mental Maturity and the California 
Achievement Tests administered to all subjects in the eighth grade, chronological 
age, and sex was entered on a cumulative record sheet for each subject. 




Gtntral Dtilgn 




Tht general datlgn for tha atudy conalatad of adalnlatarlng the claaal- 
flcatlon taaka deacrlbad above, acorlng thaaa Inatrumenta for quantity whera 
approprlata, for accuracy where appropriate, and for quality where appropriate. 
In addition to thaae acoraa, acoraa obtained by the aubjacta on the CTMM and 
CAT, and taachara gradaa ware entered on data carda for IBM proceaalng. 

Maana and atandard devlatlona were conputad for all variables, and all 
variables were Intercorrelated using Pearson Product Moment Correlation. 

In addition to this statistical treatment, scores for the flfty^four sub~ 
jects were distributed by stanlnes on several variables. This procedure allowed 
the performance of Individual subjects on any classification task to be compared 
with his performance on the remaining classification tasks and his standing on 
CTMM IQ and Grade Point Average. Profiles were prepared for all subjects. 



Description of Sample 

Subjects for this Investigation were pupils enrolled In two sections of 
eighth grade English In the Nicholas Junior High School, Fullerton School 
District, Fullerton, California. Data were gathered In the classroom during 
regular class periods on five successive Thursdays In April of 1966. Fifty- 
four pupils completed all research tasks. Cumulative data sheets were prepared 
for the subjects. Data from these cumulative record sheets are summarized on 
Table I. 
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TABLE I 

SUMMARY OF DATA FROM CUMULATIVE RECORDS 



Variable 


Mean 


SD 


Grade Point Average® 
Math 
Reading 
English 
Spelling 
History 


1.8 

2.0 

2.0 

2.6 

1.9 


.63 

.66 

.65 

.84 

.66 


Total 


2.1 


.58 


California Test of Mental Maturity 
Language IQ 
Non-language IQ 


101.9 

101.1 


11.1 

14.9 


Total IQ 


101.7 


10.5 


California Achievement Test 

Reading Vocabulary Percentile 
Reading CompreherkSlon Percentile 
Arithmetic Reasoning Percentile 
Arithmetic Fundamentals Percentile 
English Mechanics Percentile 
Spelling Percentile 


65.1 
53.9 
39.7 

33.6 

64.1 

63.6 


17.7 
23.2 
21.9 

21.4 

18.5 

26.7 


Chronological Age 


13.3 


.943 




®A=4; B-3; C-2; D-1; F-0 




The means and standard deviations reported in Table I demonstrate that the 
two classes studied were if anything slightly below average groupS| Doth in 
terms of measured IQ and grade point average. In terms of achievement as meas- 
ured by standardized tests the sample is below the norms for both arithmetic 
reasoning and arithmetic fundamentals. Otherwise, all are above the median. 

It was our Intent to study typical junior high school students— to avoid classes 
homogeneously grooped aa either gifted or slow learners. The mean IQ of 101.7 
IndlLtes that our sample is average, a standard deviation of 10.4 indicates 
that the sample contains few extremes. The highest IQ reported was 136, and the 
lowest was 72. The findings of the study therefore may be said to be applicable 
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to typical eighth grade atiidenta. 



Dat a and Inatrumentatlon 

The unique feature of thla project la that the Itaaa to be used in the 
Inatrument were designed by college atudenta using words produced by the sub-* 
Jecta themselves. One of the primary goals of the study was to discover whether 
Items designed by college students In accordance with the definitions used by 
Guilford in his descriptions of the Structure of Intellect would allow the sub- 
jects to demonstrate the kinds of differences hypothesized by the model. 

Since an analysis and evaluation of the classification instruments is an 
Integral part of the study , descriptions of them and the kinds of data they 
produce are discussed in Part II of this report. 



Limitations of the Study and the Report 

1. Statistical treatment: It has been the Intent of this study to try to elicit 

the Intellectual abilities described by the Structure of Intellect as they 
may be elicited in a regular classroom setting with Instruments and techniques 
such as a teacher realistically might be expected to devise and utilize • and 
to score and treat the data In much the same fashion as a teacher might tally 
and score his own tests and teaching exercises. Data gathered and scored in 
this way, and with untested Instruments, are not precise enough to lend them- 
selves to sophisticated statistical analysis. For these reasons many statis- 
tical procedures that might have been appropriate to a more carefully con- 
trolled study have not been employed. The correlation coefficients reported 
throughout the study should be Interpreted as merely suggestive. 

2. Terminology* There has been no attempt In this report to differentiate among 
the terms, "classes," "categories," and "sets." The three terms are used 
Interchangeably. The word "category" was used consistently when communi- 
cating with the subjects because a trial run had demonstrated that with eighth 
grade children the term "category" conveys essentially what Guilford means 

by his term, "classes." 

3. Related research: The most obvious weakness of this report is its failure 

to relate the procedures, terminology and findings to the work of other 
investigators in the field. This deficiency will be rectified before the 
material in this preliminary report is submitted for publication. 

4. Documentation: Until the very recent publication of Guilford's new worky 

The Nature of Human Intelligence .^ it was impossible to know the current 
status of Ideas which have appeared from time to time in progress reports 
from his laboratory. The publication of this definitive work will permit 
much more coherent documentation. Therefore, a min im u m of docusiantatlon 
appears in this preliminary report. 



Guilford, J. P., The Nature of HumSn Intelligence. New York: McGraw-Hill, 
Inc., 1967 
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5. Interpretations of the Findings: This study was initiated by a teacher of 

teachers with the purpose of evaluating a practice designed to improve the 
quality of preparation of the prospective teacher. During the analysis of 
the data, certain ideas which seem relevant to the teacher-education program 
have occurred to the investigator. Some of these ideas which may not seem 
to be entirely warranted by the data may have found their way into this 
report. 
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DIVERGENT PRODUCTION OF CLASSES 



Definitions 



Divergent Production: "Generation of Information where the emphasis Is upon 

variety and quantity of output from the same source. 

Classes: "Conceptions underlying sets of Items of Information grouped by vir- 

tue of their common properties."^ 

Operational Definition-Divergent Production of Classes: To generate or produce, 

from the same source, a variety and or quantity of classes, sets, or cate- 
gories In which Items are grouped by virtue of their common properties. 



Data Collection 



Data relevant to Divergent Production of Classes were gathered during the 
first data gathering session as a two-step process. The first step Is referred 
to throughout this report as Divergent Production of Units, and consisted of 
an exercise In which the subjects wrote all of the words and Ideas suggested 
by the stimulus word LAW?* At the end of ten minutes, the subjects were Instructed 
to write the word "time" on their answer sheets In the space after their last word. 
Subjects kept these answer sheets In their possession during the remainder of the 
session, and were Instructed to add to their lists If they felt like doing so 
during the discussion which Intervened between the Divergent Production of Units 
task described above and the Divergent Production of Classes task which Is to 
be described shortly. 

While their answer sheets were still In the possession of the subjects, by 
way of Illustrating the great variety of words suggested by the subjects, the 
Investigator made a list of words on the chalk board. This was accomplished 
by having each subject. In turn, call out a word from his list until some 100 
different words had been mentioned. This list of words remained on the chalk 
board during the remainder of the session. Now, each subject had access to his 
own list of words, and to the list on the chalk board contributed by him and 
his classmates. 

At this point In time, the Divergent Production of Classes answer sheet was 
distributed to the subjects. This sheet was subdivided Into a number of boxes, 
and was otherwise blank except for Instructions at the top of the page.^ 

The Investigator read the Instructions aloud as the subjects read them from 
the answer sheets. A short discussion was conducted In an effort to clarify the 
nature of the task. The following example was used as Illustration: "(TEACHER, 

PREACHER, NEWSCASTER) . You might put these together Into a category because they 

•■■Guilford, J. P. & Hoepfner, R., "Structure of Intellect Factors and their Tests, 

1966." Aptitudes Research Project Publications, No. 37, University of 

Southern California, Department of Psychology. 

2see Appendix Page 58; for copy of answer sheet. 

3See Appendix Page 59, for copy of answer sheet. 



arc all paopla who talk a lot. (TEACHER, DOCTOR, LAWYER) Thasa ara all pro- 
faaalons. (TEACHER, BOOK, DESK) Thaaa ara all objacta found In the classroom. 
(TEACHER, PROFESSOR, INSTRUCTOR) Thasa go togathar bacausa they describe peo- 
ple who perform the same function— synonyms." 

The instructions directed the subject to think of as many three-word cate- 
gories as ha could and to write each category in one of the boxes on the answer 
sheet . 

In short, (1) the subjects were asked to write all the words suggested to 
them by the stimulus topic LAW. Many of these words were written on the chalk 
board. (2) Then, subjects were asked to make as many three-word classes or 
categories as they could in thirty minutes using these words or any others they 

needed. 



Treatment of the Data- Dlvergent Production of Classes-Quantlty/Varlety 

Three Divergent Production of Classes scores for each subject were obtalned- 
two by special treatment of the words (units) written in response to the stimulus 
topic LAW, and the third by a simple count of the three-word categories produced 
in response to the Divergent Production of Classes task. The first two scores 
(these obtained from a special treatment of the words produced to the stimulus, 
LAW) are considered evidences of "variety"— the third a measure of "quantity." 

The definition of Divergent Production, It will be remembered, stresses variety 
and quantity of output. The method of arriving at variety scores Is discussed 

first. 

Variety of Classes 

Each subject wrote as many words as he could think of in response to the 
topic In a ten-minute period. A master list of most of the words mentioned by 
all of the subjects was assembled. The words were arranged by the project staff 
into nine major divisions and thlrtyrone subdivisions as follows: 



I. 

II. 

III. 

IV. 

V. 

VI. 

VII. 

VIII. 

EC. 

Total number of major divisions— 9 Total number of subdivisions— 31 



Major Divisions Number of Subdivisions 

High level abstractions 1 
Forms, Definitions, Purposes 3 
Enumeration of legal documents or 5 
Specific Laws 

Pertaining to Legislation 1 
Pertaining to Govt.— Miscellaneous 6 
Pertaining to Enforcement 6 
Pertaining to Judicial System 5 
Pertaining to Law as a Profession 3 
Other ^ 



^See Appendix Page 73, for a copy of this scoring key. 
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The worde, errenged In thle aenner and under theee heading! » were repro- 
duced aa acorlng keya. The reaponaea of each aubject were tranaf erred to a 
scoring key bearing hla code number by circling the words on the scoring key 
that appeared on the list he had written during data gathering. Thus, It be- 
came a simple procedure to count the number of major divisions and subdivisions 
under which his words had been tallied. 

For example, one subjects may have written thirty words all of which were 
tallied under the Major Division VI, "Pertaining to Enforcement." In such a 
case the subject’s Major Division score would be "1." If this hypothetical 
subject's words were tallied within all six subdivisions under Major Division VI, 
his subdivision score would be "6." 

The number of Major Divisions a subject's words were tallied under consti- 
tuted one measure of variety and the number of Subdivisions constituted a second 
measure of variety. 

Quantity 

The second type of data relevant to Divergent Production of Classes comes 
from the task requiring subjects to write as many three^ord categories as they 
could In thirty minutes. Scoring amounted to a simple count of the number of 
three-word combinations written. There was no upper limit specified for this 

Time constituted the only limitation. In the thirty minutes allcwed for 
the task, the most prolific subject wrote fifty— six sets of three words and the 
least prolific wrote as few as nine such seta* 

Findings 

For each subject, three scores are available as relevant to Divergent Pro- 
duction of Classes. The scores are (1) Number of Major Divisions under which 
words on the Divergent Production of Units task were tallied (DPU-Major Division), 
(2) The number of subdivisions under which words on the Divergent Production of 
Units task were tallied (DPU-Subdlvlslon) , and (3) The total number of three- 
word sets written In the Divergent Production of Classes task (DPC-Quan). 

These three variables were Intercorrelated. The data are summarized on 
Table 2-1, below: 



TABLE 2-1 

SUMMARY OF INFORMATION OF THREE VARIABLES 
RELEVANT TO DIVERGENT PRODUCTION OF CLASSES 



Variables 


Possible 


Extremes 
Low Hlsh Mean 


SD 


Intercorralatlons 
(1) (2) (3) 


1. DPU-Major Divisions 


9 


3 


8 5.9 


1.3 


... 


.699 


.323 


2. DPU-Subdlvlslons 


31 


5 


18 12.4 


2.7 


.699 


... 


.306 


3. DPC-Ouan 


No Limit 


9 


56 25.6 


8.7 


.323 


.306 


— — 



Significance Levels: .269 at .05; .348 at .01; .453 at .01. 



-14- 



We see from row 1, In Table 2-1, that DPU-HaJor Division correlates to a 
considerable extent with DPU-Subdlvlslon C*699)« This high correlation Is pre- 
determined to a certain extent by the manner In which the scoring manual was 
arranged. A low correlation could have occurred only If a pattern like the 
following had been typical of the sample! Six or seven words tallied one each 
In several major divisions together with a piling up of the remaining words In 
one or two subdivisions. The high correlation obtained confirms what one might 
expect— that If the words a person thinks of fit Into a variety of major divi- 
sions, they will also be distributed Into a variety of subdivisions. This sug- 
gests that the subdivisions breakdown on the scoring manual added little «.o our 
analysis and Is dropped from further consideration In this report. 

Line 1, of Table 2-1, reports a correlation between DPU-Major Division and 
DPC-Quan. of .323. Although a positive correlation of this magnitude would not 
lead us to conclude that a measure of quantity Is also apt to be a measure of 
variety. It does allow us to reject the opposite — that the production of quantity 
reflects a tendency to confine oneself to a narrow range of Ideas. 

The data summarized on Table 2-1 shows that there are very great differences 
among eighth graders, especially In the DPC-Quan. measure. In an attempt to learn 
whether these differences relate In any way to school achievement or aptitude, the 
DPU-Major Division and DPC-Quan. scores were correlated against 15 scores from the 
cumulative records. These correlations are reported In Table 2-2. 



TABLE 2-2 

CORRELATIONS BETWEEN CUMULATIVE RECORD VARIABLES 
AND VARIETY OF CLASSES AND QUANTITY OF CLASSES® 





DPU y/ of Major 
Divisions 


DPC 

Ouan 


(1) 


Math 6PA 


125 


136 


(2) 


Reading 6PA 


280 


195 


(3) 


English 6PA 


191 


205 


(4) 


Spelling 6PA 


239 


209 


(5) 


History GPA 


214 


142 


(6) 


Total GPA 


254 


202 


(7) 


CTMM Language IQ 


251 


049 


(8) 


CTMM Non-language IQ 


-119 


007 


(9) 


Total IQ 


048 


071 


(10) 


CAT Reading Vocabulary 


278 


083 


(11) 


CAT Reading Comprehension 


254 


023 


(12) 


CAT Arithmetic Reasoning 


-oil 


001 


(13) 


CAT Arithmetic Fundamentals 


124 


007 


(14) 


CAT English Mechanics 


041 


186 


(15) 


CAT Spelling 


228 


301 




^Decimal points omitted. 

Significance levels! .269 at .05; .348 at .01. 
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The most Impressive thing about Table 2-2, Is the paucity of correlations 
that approach significance. Of the 30 correlations reported, only three are 
significant beyond the .05 level. Rov 2, shows a correlation of .280 between 
DPU-Major Divisions and teachers' grades In reading. Row 10, reports a correla- 
tion of about the same magnitude between this variable and CAT Reading Vocabu- 
lary. Despite these correlations and a correlation of .301 between CAT Spelling 
and DPU-Qi'ian. on Row 15, It Is safe to generalize from Table 2-2 that the Diver- 
gent Production of Classes ability as It was tapped In this research Is essen- 
tially unrelated to academic aptitude or achievement. 

Having demonstrated that the DPC-Quan score Is positively and significantly 
related to Variety of Classes as tapped on a quite different kind of task and 
type of analysis (DPU-Major Divisions), DPC-Quan Is retained as the single meas- 
ure of Divergent Production of Classes throughout the remainder of this report. 



Treatment of Data- Dlvergent Production of Classes-Quallty 

The preceding section of this paper has described methods of scoring for 
Divergent Production of Classes when the ability Is confined to variety and 
quantity. A cursory examination of the three-word combinations written by the 
subjects In response to a request to write three-word categories, revealed sub- 
stantial differences In quality of output. How to resolve the dilemma of whether 
to score or not to score for quality? In one respect, the practice of evaluating 
quality In an ability (divergent production) defined as emphasizing "quantity and 
variety of output" appears to be a contradiction In terms. While In another 
respect, assuming that any three-word combination should be called a class does 
violence to the part of the definition which specifies classes as Items of Infor- 
mation "grouped by virtue of a common property." 

This Issue was handled by a decision to score the protocols for quality and 
to postpone until later the decision as to whether to call the resulting scores 
measures of Divergent Production or to assign them to one of the other operations. 
For reasons of clarity, however, the procedure to be described Is referred to 
throughout the report as Divergent Production of Classes-Quallty (DPC-Qual). 

Scoring Procedures and Comments on Scoring 

A five-point rating scale was devised and criteria were developed for each 
rating. A rating of ^ represented the highest score any class could be given. 

In an effort to achieve consistency In scoring, two Judges rated each protocol. 
Where there were disagreements between the Judges on an Item, the differences 
were resolved through discussion. 

Before beginning this description. It may be well to repeat that the classes 
being evaluated here, were written by the subjects In thirty minutes. In response 
to a request that they write as many three-word categories as they could using 
words they had Just produced In association to the word LAW. The fifty-four 
subjects wrote a total of 1381 three-word classes. Each subject's handwritten 
protocol was typewritten and spelling errors were corrected before the ratings 
were done. 
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Qualltv Ratings of 5 

Criteria 1-All three words must be the same part of speech so that the rater 
can say "These go together because they are all ••• people, 
places, objects, institutions, functions, processes, qualities, 
documents, adjectives, etc*, and 

2- have the same relationships to a superordinate heading, or 

3- are on the same level of abstraction, or 

4- are on the same level of generality, or 

5- are synonyms 

Certain concepts which meet our criteria are learned in sets of three. The 
following examples appear frequently? (LEGISLATIVE, EXECUTIVE, JUDICIAL), (DEMOC- 
RACY, COMMUNISM, SOCIALISM) , (JUSTICE, FREEDOM, LIBERTY). 

Following are other examples: (FBI, CIA, SAC), C^GENTS, G-MEN, DETECTIVES), 

(BAD, MEAN, TERRIBLE), (AMENDMENT, CHANGE, ADDITION) , (FATHER, MOTHER, BROTHER), 
(FATHER, JUDGE, PRESIDENT), (JUVENILE, MINOR, CHILD), (PROSECUTOR, DEFENDANT, 
VICTIM), (MURDERER, KIDNAPPER, SMUGGLER), (PRISON, JAIL, DUNGEON), (ELECTRIC 
CHAIR, GAS CHAMBER, FIRING SQUAD), (SUMMONS, CALL, DRAFT), (BAD, ILLEGAL, WRONG), 
(SUBPOENA, TICKET, CITATION), (ORDER, ASK, REQUIRE), (STATE LAW, COUNTY LAW, CITY 

LAW). 



Ratings of five points were also assigned to classes In which raters could 
discern an effort by the subject to capture an illusive concept, which had fal- 
len short only because of Inability properly to convert nouns Into verbs or verbs 
Into adjectives, etc. 

(FUGITIVE, ESCAPE, RUN-AWAY), (RESTRICTION, PROHIBITED, ORDER), (INCOGNITO, 
FALSE, DISGUISE), (TRESPASSING, OFF LIMITS, PROHIBITED), (BILL, FINE, TICKET). 

We cannot leave these examples without commenting on the truly remarkable 
potential we see In this exercise for stimulating an Interest both in ideas 
and in precise ways of communicating them. In these exercises the youngsters 
are working with Ideas and concepts they already have. By placing three words 
together Into a class they are demonstrating that they have a concept. What a 
superb opportunity for a teacher to use the excellence a pupil has demonstrated 
to encourage him to take the next step— that of finding the most precise way of 
labelling or communicating his concept. 

Frequency of Response 

Our findings indicate that a very small percent of the total 1381 classes 
produced meet the criteria for the highest rating (11%). All but six subjects 
had at least one of their classes scored five points* The subjects differed 
both In the absolute number of classes receiving a rating of five and in the 
proportion of their total classes being so rated. The highest absolute number 
of classes scor<2«l five for any one subject was nine. The highest proportion 
of total classes scored five for any one subject was 39%. The mean number of 
five point classes per subject was 2.f*. 
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Conments 

It Is difficult succinctly to describe the process followed by the indi- 
vidual in performing the task. He did not have unlimited freedom since he was 
Instructed to begin his class with a word that had been associated to the word 
LAW and was either on his own list or written on the chalk board. Beyond this, 
he was free to search among all the words he knew to find two others to go with 
his first. Some of the words associated to the word LAW' represented concrete 
objects— GUN, BADGE, AMBULANCE— but many of the words written on the chalk board 
were abstract— GOVERNMENT, ILLEGAL, VERDICT, etc. The eighth graders could have 
selected a word that stood for a concrete object making the task considerably 
easier, but generally speaking, they did not. 

We might typify the process, then, as one in which the subject began a 
class with a fairly abstract concept from those given and then searched among 
all the words he knew to find two more words to go with it. Our findings sug- 
gest that eighth graders, as far as our sample is typical, far more often than 
not, are unable to find three words that share both intrinsic commonalities 
(same part of speech) and common levels of abstraction. In the discussion of 
four-point classes which follows, one kind of difficulty they experienced is 
illustrated. 

Quality ratings of 4 

Criteria 1-All three words in the class must be the same part of speech so 
that the rater can say "These go together because they all... 
are people, places, objects, events, documents, processes, etc. 

2- They fall short of earing a 5 rating because of mixed levels of 
abstraction or generality, or 

3- Because they lack a common orientation in relation to a super- 
ordinate heading. 

Examples! (POLICE, COP, BATMAN) These go together because they are all 
people, but the first two are general and the third, BATMAN, is specific. 

(DEATH, MURDER, SUICIDE) These three go together because they are all processes, 
but the second two are instances of the heading DEATH. (LEADER, DICTATOR, KING) 
Dictators and kings are both leaders; (BYSTANDER, PEOPLE, FATHER) Father and 
bystander are both people; (PUNISHMENT, FINE, ELECTRIC CHAIR) all consequences 
of being found guilty, but fine and electric chair are forms of punishment; 
(DOCUMENTS, CONSTITUTION, MAYFLOWER COMPACT) Constitution and Mayflower Compact 
are specific documents; (RELIGION, CATHOLIC, MORMON) Cdthollc and Mormon are 
types of religion. 

In these examples, we can glimpse the effort of the subjects to group 
together only words of the same part of speech. It looks very much, however, 
as though the subject used his first word as a heading and then found two others 
which were examples of the first. 

Frequency of Response 

Nineteen percent of all classes produced were assigned ratings of "4". Ml 
subjects had at least one of their classes so rated. The highest number of 4 
ratings achieved by any subject was 12, while the' highest proportion of total 
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classes rated "4” for any subject was 65%, The mean per individual for the 
sample was 4,9 four-point classes. 

Comments 

In the above examples, we are struck by the classic examples of mixed 
levels of abstraction produced by these youngsters. It is doubtful whether 
any teacher or author could create workbook exercises which are any more graphic. 



Quality Ratings of 3 

Criteria 1-Two words that are the same part of speech so that the rater can 
say, "These two are ,,, people, places, processes, events, etc," 
2-A third word of different part of speech which relates to both 
of the other two in an asymmetrical way. 

Examples: (JUDGE, JURY, TRIAL), (GUILTY, INNOCENT, VERDICT), (OBEY, DIS- 

OBEY, RULES), (PRESIDENT, LEADER, IMPORTANT), (LESSONS, HOMEWORK, TEACHER), 

(LOOK INTO, INVESTIGATE, FBI), (DIVORCE, BREAK-UP, ARGUMENT), 

In several of these Items the subject began with a set of opposites, for 
example (GUILTY and INNOCENT), In this particular Item there Is no way for the 
subject to complete a three-word class that would meet criteria for 5 points 
unless he were able to come up with something as sophisticated as HUNG JURY or 
MISTRIAL for his third word. So, in a sense, starting off with a pair of oppo- 
sites poses nearly unsolvable problems for the subject. Beginning with a pair 
of synonyms, also poses considerable difficulty. In the example, (OFFENSE and 
CRIME), the subject could have completed a 4-polnt class by adding a word like 
ROBBERY or FELONY but to achieve a five-point class he would have had to come 
up with a word like ILLEGALITY, 

Frequency of Response 

Twenty-six percent of all classes produced were rated "3", The greate^X 
number of such classes written by a subject was 14, The highest proportion of 
total classes scored "3" for any Individual was 66%, Mean for the sample was 
6,^ per subject. 

Comment 

One can only speculate, of course, but perhaps the problem leading to this 
kind of response is lack of foresight— the tendency to write a pair of words 
which frequently occur together in common usage before one has tested to see 
whether he can find a third. 

Quality Ratings of 2 

Criteria 1-Three words are of different parts of speech — ^verbs, nouns, 
adjectives, 

2-All seem to relate to each other as part of a sequence, event, 
or setting. 



-19- 



Examplet: (VETO, BILLS, NO GOOD), (CURFEW, TIME, LIMIT), (TREATIES, 

COUNTRY, PEACE), (LIE DETECTOR, PRISONER, FALSIFY) , (CITY HALL, LOCAL, ENFORCE- 
MENT), (ARREST, INNOCENT, FREE), (TRAITOR, RAT, TREASON), (ARREST, CRIME, PUNISH- 
MENT). 



In these Iteme there eeeme to be no dlecerneble effort to create e dess 
except perhaps in a temporal spatial, or situational sense. 

Frequency of Response 

Thirty-nine percent of all items were of this type. All but one of the 
subjects had at least one such rating. Mean for the sample was 10 per individual. 
One subject produced thirty-one classes that received ratings of ”2.” The highest 
proportion of total classes scored ”2” for any individual was 66% 



Quality Ratings of 1 

Criteria 1-Three word combinations that do not meet the criteria for receiv- 
ing’ a higher rating. 

Examples: (ORDERED, LINE, ACCUMULATED), CCONGRESS, JURY, TRIAL), (OBEY, 

LAWS, CRIME), (DRIVING LAW, TRAFFIC TICKET, RIOT), (WITNESS, DIVORCE, CRIMINAL). 

These items appear to be more nearly a continuation of the DPU tasks than 
attempts to find words that fit into a category based on a common attribute. 

Frequency of Response 

Only five percent of the total classes produced were rated ”1.” Since 
twenty subjects had no such scores, these one— point classes are excluded from 
further analysis in this report. 

Distribution of Ouallttv Ratings, 

Table 2-3 summarizes the data on the distribution of quality ratings. 

i 

TABLE 2-3 

SUMMARY OF QUALITY RATINGS FOR CLASSES PRODUCED IN RESPONSE 
TO DIVERGENT PRODUCTION OF CLASSES INSTRUCTIONS 

Quality ratings 



* 


,W. ■ 
One 
point 


IPJ w ^ 

two Three Four Five 

Solnt* Points Points Points 


— 

Total 


Cl) Number 


73 


541 


345 


265 


148 


1381 


(2) Percent of total 


5% 


39Z 


26% 


19% 


11% 


100% 


(3) Mean per subject 


1.4 


IO..O 


6.7 


4.9 


2.5 


25.6 

A *1 


(4) Standard deviation 


* 


5.5 


3.4 


2s6 


2 • 1 


8e7 



*Not normally distributed. 
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5 J% 

In1^U« the modal rating was **2." These ratings were given 

to mixtures of parts of speech In which It appeared to the rater that the sub- 
ject was naming three words which frequently occur together In context— words 
that constitute the basis of a sentence. The subject seemed to be making no 
effort to apply t)ie test that was suggested during the Instructions— ”these go 
together because chey are all..." The next most frequently assigned rating was 
”3", given to classes In which the subject seemed to be trying to classify, but 
made his task difficult by starting with a pair of opposites or synonyms and so 
completed the three-word set with a word (usually of a different part of speech) 
which related to both of the other words. The third most frequent rating was to 
*%*' point classes In which the thraa words were of the same part of speech so 
that the rater could say, "these are all people, places. Institutions, levels of 
government, etc," but represented different levels of abstraction. It was as 
though the subject thought of one word which he used as a ’lneadlng" then searched 
to find two words which could be subsumed under It. Five-point ratings were 
assigned to classes In which the words were all of the same part of speech and 
could be seen as "all being processes, people, qualities, etc.” and In addition, 
shared a common level of abstraction. These kinds of classes accounted for only 
llX of the total. 

We may summarize by saying that the ability to construct classes with three 
abstract words— symbols for such concepts as Institutions, processes, functions, 
etc.— which share a common level of abstraction seems to be poorly developed In 
eighth graders. Nearly 40% of their Items could be seen as classes only as they 
represent words which frequently occur together In context. Nevertheless, from 
the nature of the vocabulary selected for their efforts and from the effort to 
classify dlscemable In 56% of their Items (quality rating for 3, 4, and 5) we 
sense a readiness In these subjects to gain control of abstractions. 



Validity of the Quality Ratings 

The paragraphs above have described five styles of response to the DPC 
task and have described the frequency with which each was found among the total 
number of classes produced. The assigning of quality ratings of "2" points to 
some kinds of Items and "3" points to others and so forth implies not only dif- 
ferences In style, but also a graduated scale of quality. The differences In 
quality Implied by such gradations can be validated by demonstrating that higher 
correlations obtal&'eja® rating and some criterion measure than obtain between 
the next lower rating and the same criterion measure. 

Table 2-4 on the next page presents an array of correlations that are 
Instructive In relation to this question. 
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TABLE 2-4 

COHPARISONS Of NUMBER OF CLASSES ASSIGNED QUALITY RATINGS OF 
2, 3, 4, AND 4r WITH CUMULATIVE RECORD VARIABLES AND OF IQ WITH 

ACHlBVmmX VAIHABI.ES* 



MatK GFA 

Reading GPA 

Englifh GPA 

Spelling GPA 

History GPA 

GPA-Totel 

CTMM Language IQ 

CIMM Non- language IQ 

CTHM Total IQ 

CAT Reading Vocabulary 

CAT Reading Comprehension 

CAT Arithmetic Reasoning 

CAT Arithmetic Fundamentals 

CAT English Mechanics 

CAT Spelling 



■Decimal Points omitted 
Significance levels: .269 at .05; 





Number of Classes 




CIMM 

m. 


2 

*olnts. 


3 

Points 


4 

Points 


5 

Points 


116 


-054 


093 


306 


425 


251 


033 


033 


168 


202 


246 


004 


012 


176 


342 


236 


020 


003 


245 


253 


150 


-068 


-024 


379 


347 


222 


-015 


018 


309 


337 


061 


-064 


082 


451 




004 


013 


079 


229 




047 


-038 


100 


403 




-017 


-158 


164 


461 


150 


-050 


-083 


-009 


351 


465 


-104 


-174 


206 


407 


402 


023 


-151 


082 


321 


396 


136 


032 


069 


163 


229 


221 


064 


206 


285 


048 


348 at 


.01; .435 


at .001. 







Assuming that the quality ratings which correlate best with the cumulative 
record variables related to school performance are of highest quality, the first 
three columns of the table tell us that classes we have rated "4" are not of 
higher quality than classes we have rated "2". Moreover, the large number of 
slightly negative correlations In the column defiling with quality ratings of 
”3” suggest that these are of the poorest quality. 

However, since none of these 45 correlations Involving "2", "3", and "4" 
point classes Is significant and since there are no absolutely consistent In- 
creases or decreases when moving from one rating to another. It Is fairly safe 
to conclude that what we have described as quality differences In assigning 
point scores of 2, 3, or 4, are apparently nothing more than syllstlc differences. 
The one possible exception to this generalisation Is that the tendency to pro- 
duce three-word combinations which mix classes and relations In the same Item 
(quality ratings of "3") may be Indicative of an Intellectual habit which is 
antithetical of learning. 

When the column in the table which presents correlations Involving quality 
ratings of "5" is examined, a different picture emerges. In a) I correlations 
except those with GPA In Reading and English, the correlations are higher than 
for "2", " 3 ",oF» 4 " point classes, and ten of the correlations now reach statistical 
significance. Using cumulative record variables as the criterion of quality, then 
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VC may conclude that only thoce claiiai which are conpoeed of words sharing 
both an Intrinsic attribute and a coasiott level of abstraction should be con 
sldered to be of good quality# 



Uslna the number of ”5*' point classes produced as a measure of quality 
(DPC-Qual), positive and significant correlations were found with ten of the 
fifteen cumulative record variables# Exa min ation of Table 2-4 permits a com- 
parison between the magnitude of these correlations with GPA and Achievement 
Test Scores and the magnitude of the, correlatldhs of COW IQ with these same 
variables# It Is Interesting to note that for Reading GPA, Spelling GPA, and 
CAT English Mechanics, neither CTMM IQ nor DPC-Qual correlates significantly# 

For Math GPA, Total GPA, CAT Reading Comprehension and Arithmetic Fundamentals 
both measures correlate significantly although correlations of the variables 
with IQ are of higher magnitude# For History GPA and CAT Arithmetic Reasoning 
both measures correlate significantly, but DPC-Qual has a very slight edge In 
terms of magnitude# Only In the case of English GPA does IQ correlate 
cantly while DPC-Qual does not, while In two Instances, CAT Reading Vocabulary 
and CAT Spelling, DPC-Qual, correlates significantly while IQ does not# 

Tosuifflnarlse, using the DPC-Qual (the number of classes produced which 
received a rating of as a measure of academic aptitude, we find that It 

correlates significantly with eight measures of academic achievement while 
IQ correlates significantly with 7# While the magnitude of the correlations 
of these measures with IQ Is considerably higher 
Comprehension, the others are remarkably close, and the JPC-Qual 
hl^er than IQ In Its correlations with CAT Reading Vocabulary (#461 as compared 

to #150)# 



The DPC-Qual measure correlates positively and significantly with both 
CIMM l 4 inguage IQ (#451) and with Total IQ (A03)# 



Sima^-Dlvergent Production of Classes 

Responses of the eighth grade subjects on a task requiring 
many three-word categories as they could revealed great differences am g 
In both quantity of classes produced and quality of classes produced# '^®*| 
scored for Quantity# the scores were essentially unrela^d to measures of academic 
aptitude, thachers grades or achievement test scores# When scored for 
the scores were positively and significantly related to teachers grades, to Q, 
and to four out of five achievement test variables# 
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CONVERGENT PRODUCTION OF CLASSES 



DeflUittlons 



Convergent Production: "Generation of information from given information where 

the emphasis is upon achieving unique or conventionally accepted best out- 
comes. It is likely the given (cue) information wholly determines the 
response. 

Classes: "Conceptions underlying sets of items of information grouped by virtue 
of their common property."^ 

Operational Definition-Convergent Production of Classes: Generation of classes, 

sets or categorigyby selecting from an array of items those that share an 
intrinsic commonality when the nature of the comronality is not specified 
and where there is a best or uniquely correct answer. 



Preparation of the Instrument 

The preceding section of this report described a Divergent Production of 
Units task in which eighth grade subjects wrote words in response to the stimulus 
topic LAW. An alphabetized master list of all of the words written by the sub- 
jects was distributed to two sections of a college class composed of prospective 
teachers. Together with the list of words, the college students were given skele- 
ton items, the form of which is described subsequently. The skeleton items in- 
cluded only the instructions which would appear on the instrument when it was 
administered to the subjects. The task for the college students was, using the 
words on the master list or variations of them, to prepare completed items to fit 
the directions. The items prepared by the college students constituted a pool of 
items from which the project staff selected those which were included in the instru- 
ment . 2 



Rationale for the Format of the Convergent P roduction of Classes. It^s 

The test used by Guilford in his original work on this factor was a simple 
list of words which the subject was required to divide into two lists. In order 
to accomplish this task, the subject must literally create or produce classes— 
must decide what classes are embedded in the array of words. It was the wish to 
build variety into the tasks for the eighth graders that led us to experiment w t 
the several different types of items finally used. The question of whether we 
succeeded in retaining what is essentially Convergent Production of Classes des- 
pite the variety of formats used is discussed later in this section. 



^ Guilford, J. P. and Hoepfner, R., "Structure of Intellect Factors and t^ir 
Tests, 1966" Aptitudes Research Project Publications, No. 37, Unlrerslty 
of Southern California, Dopartment of Psychology. 

2 See Appendix Pages 60-65 > for a copy of this instrument. 
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Xhe Instrument was composed of four kinds or types of Items — Matching, Same- 
word Matching, List Division, and Crossword. Each type of Item Is Illustrated In 
the material which follows: 

Matching: Each matching Item was composed of several boxes In each of which 

a class wae begun with two words or terms. Included also was an 
array of words from which the subjects must select one word to 
write In each of the boxes so that the three words conetltute a 
class. Item 3, from the Instrument Is reproduced below. 



ITEM 3. 



BRASS KNUCKLES 
GUN 


GLOVES 

SHOES 

. .. - ... „ ] 


MAYOR 

PRINCIPAL 


i DISTRICT 

i CITY 


lu j 

I 

MURDER 

ROBBERY 


1 

1 

JUVENILE HALL 
JUVENILE COURT 



ARSON 

DELINQUENT 

PRECINCT 



HELMET 

FATHER 

SWITCHBLADE 



The Illustrated Items contains six boxes (classes to be completed) and six 
words to be classified. For each word written Into the box which was considered 
correct, one point was assigned. The matching Items Included twenty-four words 
to be matched with twenty-four classes. 

Same-word Matching Items: This kind of Item Is a variation of the matching 

Item. The Item used with the subjects as an example, together with the 
Instructions, Is reproduced on the following page. 
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Instructlons: Host words can be put Into several different categories 

when we think of different ways In which they are used or when we group 
them with other words which share a common attribute. In the Items 
below, a word Is used to begin each of several different categories. 

In the sample Item, #8, two words have been added to the word POLICEHAN 
In each column to give us a clue as to the category that has been start- 
ed. Our job Is to pick out from the list below the columns additional 
words to write In each box. When we have done the sample Item together, 
see whether you can do the same thing In Items 9 and 10. 



ITEM 8. 



POLICEMAN 


POLICEMAN 


POLICEMAN 


POLICEMAN 


SHERIFF 


DESK SERGEANT 


CITY ENGINEER 


AIRLINE HOSTESS 


MARSHALL 


STENOGRAPHER 


FIREMAN 


SAILOR 



COP 

CORONER 

DOORMAN 

NURSE 



PLAINCLOTHESMAN 

POSTMAN 

TEACHER 

TELEPHONE OPERATOR 



The Convergent Product lorT of Classes Instrument Included two questions of 
this type In addition to the sarnple'^'tem.^ The first Included three boxes (clas- 
ses to be completed) with eleven words to be matched to the classes, while the 
second item Included four boxes with twelve words to be matched to items. In 
all there were twenty-three words to be matched to seven categories. 



List Division: This is the classic Convergent Production of Classes task 

discussed above. The task Is to create a specified number 
of classes from an array of words. Item 13 from the instru 
ment Is reproduced below. 

ITEM 13. 



CATEGORY I CATEGORY II 



CLUE 

SUMMONS 

FINGERPRINT 

INTERROGATE 

WARRANT 

TICKET 

LIE DETECTOR 
SUBPOENA 




The five Items In the instrument Included thirteen boxes In 
which forty-nine words were to be classified. 
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Crossword: The Crossword Items required the arrangement of nine words 

Into a matrix so that both rows and columns would constitute 
classes. For each Item, six classes could be made by arrang- 
ing the words properly In the matrix. Item;^19 from the 
Instrument Is reproduced below. 



ARMED FORCES 
HIGHWAY PATROL 
HORSE 
JEEP 

MILITARY POLICE 

MOTORCYCLE 

MOUNTED POLICE 

NATION 

STATE 



ITEM 19. 




Score points were assigned for each row or column which 
Included the three words constituting any of the six classes 
built Into the Item. Twelve points were possible for the 
correct completion of both Items. 



Administration 

The Convergent Production of Classes Items were administered to the eighth 
grade subjects In two sessions one week apart. The Matching and Same— word Match- 
ing Items were used during the first of these sessions and the List Division and 
Crossword during the second. 



Scoring 

For each subject, a separate score for each of the four types of Items was 
obtained. These were determined by a count of the words classified as specified 
by the scoring key for the two types of matching Items and for the List Division 
Items. For the Crossword Items the score was based on the number of classes ar- 
ranged (rows or columns) correctly. A subject’s total score was a figure equal 
to the sum of his points on the four types of Items. A total score of 108 points 
was possible on the Convergent Production of Classes battery. 



Distribution of Scores 

Table 3-1 on the next page describes the performance of the subjects on 
the four kinds of Items and on the total Instrument. 



-27- 



TABLE 3-1 

SUMMARY OF PERFORMANCE ON THE CONVERGENT PRODUCTION OF CLASSES BATTERY 





(1) 


(2) 




(3) 


(4) 


Type of Item 


Number of 










Points Possible 


Extremes 


Mean 


SD 






Low High 






Matching 


24 


8 


2A(3)* 


17.8 


3.2 


Same-Word (Matching) 


23 


0 


17 


8.4 


4.0 


List Division 


49 


12 


49(2) 


34.3 


6.9 


Crossword 


12 


1(2) 


12(8) 


7.6 


3.0 


Total 


108 


28 


93 


68.4 


10.8 


*The numeral enclosed 


In brackets indicates 


the number 


of subjects who 


achieved the score. 


Where no numeral appears, the score was 


obtained 


by only one subject. 












There is evidence in 


column 2 that. 


with the 


exception of Same 


-word Match- 



ing, the Items were not difficult enough to allow the abler students to differen- 
tiate themselves. Three subjects achieved perfect scores on the Matching items, 
two on the List Division items, and eight on the Crossword items. From an exam- 
ination of the means and Standard Deviations it appears as though performance cn 
the List Division tasks approximated normal distribution more..nearly than did 
performance on the other tasks. 



Comparisons Among the Four Types of Items 

In part to introduce novelty into the research tasks for the subjects and 
in part to see whether items which differed from Guilford* s classic list divi- 
sion format would tap the Convergent Production of Classes ability, three kinds 
of items were used in addition to List Division. 

Because of the differences in length and in difficulty of the four kinds of 
items, intercorr elation among them are difficult to interpret, but they are instruc- 
tive in some ways. Table 3-2 presents these intercorrelations. 

TABLE 3-2 

INTERCORRELATIONS OF TYPES OF ITEMS AND TOTAL SCORE 
FOR CONVERGENT PRODUCTION OF CLASSES® 



Variable 


Notation 


xi 


x2 


X^ 


X^ 


To'ral points 


Y 


722 


576 


732 


479 


Matching 


xi 


— 


477 


199 


276 


Same-word 


X2 


477 


— - 


181 


014 


List Division 


X3 


199 


181 




200 


Crossword 


X^ 


276 


014 


200 


— - 



a. Decimal points omitted. 
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It can be seen that Matching and List Division correlated with approxl 
mately equal magnitude to the total score. Matching correlates higher with the 
Same-word Matching .477 and with Crossword .276 than it does with List Division 
.199. List Division does not correlate significantly with Same-word .181 nor 
with Crossword .200. 

Another way to approach the question of whether these three types of items 
are measuring the same or different abilities is to correlate them with some 
criteria and compare these correlations. Test scores and teachers grades from 
the cumulative records can serve as such criteria. Table 3-3 presents these 

correlations. 



TABLE 3-3 

CORRELATIONS OF SUB-PARTS AND TOTAL SCORE ON THE CONVERGENT PRODUCTION 
OF CLASSES INSTRUMENT WITH CUMULATIVE RECORD VARIABLESa 





(1) 


(2) 


(3) 


(4) 


(5) 






Same- 


List 


Cross- 






Matchlns 


Word 


Division 


word 


Total 


(1) Math GPA 


188 


305 


253 


272 


413 


(2) Reading GPA 


270 


212 


324 


402 


498 


(3) English GPA 


227 


210 


338 


431 


494 


(4) Spelling GPA 


250 


199 


178 


175 


332 


6) History GPA 


490 


344 


269 


381 


558 


(6) Total GPA 


361 


327 


326 


421 


567 


(7) Language IQ 


303 


317 


180 


121 


343 


(8) Non- Language 


IQ-218 


115 


067 


135 


-021 


(9) Total IQ 


012 


246 


191 


161 


181 


(10) Read Vocab 


600 


375 


314 


213 


530 


(11) Read Comp 


526 


429 


392 


126 


547 


(12) Arlth Reas 


144 


183 


451 


159 


370 


(13) Arlth Fund 


329 


343 


522 


173 


573 


(14) Eng Mech 


091 


296 


172 


194 


274 


(15) Spelling 


228 


269 


037 


029 


177 


^Decimal points omitted. 
Significance levels: .269 


at .05; 


.348 at . 


01; .435 


at .001. 



Examining column 5 we are struck with the fact that the correlations between 
total score and the cumulative record variables are positive and significant with 
all measures except Non— language IQ, Total IQ and CAT Spelling. We may say, 
parenthetically, that whatever abilities are being tapped on this total score are 
related to academic performance. Our effort at this point, however, is to try to 
determine whether it is Convergent Production of Classes ability that accounts 
for these correlations or whether something else is more importantly involved. 
Turning our attention to column 1, row 10, on the table, we see a remarkably high 
correlation .600, between the Matching Score and CAT Reading Vocabulary. Row 11, 
column 1, shows a high correlation .526, also between Matching and Reading Compre- 
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henslon. In order to examine the possibility that the very substantial correla- 
tion between our Convergent Production of Classes total score and these cumula- 
tive record measures may be reflecting largely vocabulary ability, the data are 
presented in another way. Table 3-4 presents the correlations between CAT Read- 
ing Vocabulary and the cumulative record variables side-by-side with the Conver- 
gent Production of Classes T tal score, correlated with these same variables. 



TABLE 3-4 



COMPARISONS OF THE MAGNITUDE OF CORRELATIONS OF THREE VARIABLES 
(CPC-TOTAL SCORE; CPC-LIST DIVISION; CALIFORNIA ACHIEVEMENT 
TEST-READING VOCABULARY) WITH CUMULATIVE RECORD VARIABLES® 



(1) Math GPA 

(2) Reading GPA 

(3) English GPA 

(4) Spelling GPA 

(5) History GPA 

(6) Total GPA 

(7) Language IQ 

(8) Non- language IQ 

(9) Total IQ 

(10) CAT Reading Vocabulary 

(11) CAT Reading Comprehension 

(12) CAT Arithmetic Reasoning 

(13) CAT Arithmetic Fundamentals 

(14) CAT English Mechanics 

(15) CAT Spelling 



(1) 


(2) 


(3) 


CPC 


CAT 




List 


Reading 


CPC 


Division 


Vo. abulary 


Total 



253 


410 


413 


324 


441 


498 


338 


449 


494 


178 


408 


332 


269 


585 


558 


326 


552 


567 


180 


408 


343 


067 


-092 


021 


191 


150 


181 


314 


— 


530 


392 


714 


547 


451 


345 


370 


522 


543 


573 


170 


362 


274 


037 


280 


177 



^Decimal points omitted. 

Significance levels: .269 at .05; .348 at .01; .435 at .001. 



The similarity between the sets of correlations in columns 2 and 3 is 
striking, a fact which adds to our growing suspicion that the Matching Items 
are more nearly measures of Structure of Intellect Units (vocabulary) than of 
Structure of Intellect Classes. 



Now, turning our attention to column 1 and 2 we can compare the correlation 
between Convergent Production of Classes-List Division and the cumulative record 
variables to those with CAT Reading Vocabulary: Now we see substantial differ- 

ences in several measures • which seem to be dependent on vocabulary . The follow- 
ing correlations are substantially higher for CAT Reading Vocabulary than for 
List Division; Spelling GPA, History GPA, Language IQ, and Reading Comprehension. 
The reverse is true for Arithmetic Reasoning. 
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These scattered and unsystematic bits of data suggest that the Total Score 
Is Influenced by vocabulary to a greater extent than Is the List Division Score 
and that we would be justified therefore, In retaining the List Division Score 
as the sole measure of Convergent Production of Classes. 

To summarize, from an Inventory of words written In response to the stimulus 
topic LAW by eighth grade subjects, college students who were In the teacher 
education program, formulated Items designed to stimulate the kind of thinking 
hypothesized In the Structure of Intellect as Convergent Production of Classes. 
Four kinds of Items were devised which have been called Hatching, Same-word 
Matching, List Division, and Crossword. 

An Instrument, which Involved the classification of 108 words In these 
various kinds of Items, was prepared and administered to fifty-four eighth grade 
pupils In two testing sessions. The Instruments were scored and the total scores 
were found to correlate positively and significantly with twelve of fifteen cri- 
teria measures of academic achievement. The highest correlations were found with 
Total Grade Point Average, CAT Reading Comprehension, and CAT Arithmetic Funda- 
mentals . 

Since one purpose of the study was to determine whether college students 
could design tasks which would stimulate students to utilize the Convergent Pro- 
duction of Classes ability, an attempt was made to see whether the Items designed 
ward. In fact tapping classification ability or were largely measures of vocabu- 
lary* The List Division task which Is similar In format to that used by Guilford 
In Isolating the factor did not correlate significantly with any of the other 
types of Items In the Instrument and did not correlate as high with criteria 
measures depending strongly on vocabulary as did the total score. It was con- 
cluded that the List Division Score was less dependent on vocabulary ability 
and, therefore, more nearly a manifestation of classification ability than was 
the total score and should be used as the measure of Convergent Production of 
Classes throughout the remainder of this report. Convergent Production of Clas- 
ses— List Division, correlated positively and significantly, but r>ot highly, 
with Grade Point Average, with CAT Reading Vocabulary, and CAT Reading Compre- 
hension. The magnitude of the correlation was highest, however, with CAT Arith- 
metic Reasoning (.451) and CAT Arithmetic Fundamentals (.522). 



MEMORY OF CLASSES 



Definitions 

Memory: "Retention or storage, with some degree of avalllbllity, of information 

In the same form it was committed to storage and in response to the same 
cues In connection with which It was learned. 

Classes: "Conceptions underlying sets of items of information grouped by virtue 

of their common property."^ 

Operational deflnltlon-Meraory of Classes: From an array of Items which have pre- 

viously been learned as categories, sets or classes, sharing a common property 
or because they are subordinated to a common superordinate heading, reproduce 
the original categories, sets, or classes. 



Preparation of the Instrument 

Using words originally produced by the subjects themselves during the Diver- 
gent Production of Units task, and working with the format of a skeleton Item 
which Included only the Instructions for the task, college students created a 
number of Items. From among those prepared by college students, the project staff 
selected the one judged to be most promising. After some refinements, the Item 
was reproduced for administration to the subjects. 



Administration of the Memory of Classes Task 

In order to design a task consistent with the definition of Memory of Classes, 
It was necessary to teach or present material which could be learned as classes 
at one time so that It could be reproduced as remembered at a subsequent time. 

This was accomplished by Introducing the material to be remembered at the close 
of one data gathering session and having it reproduced as remembered at the begin- 
ning of the next data gathering session one week later. 

The Instruction Phase 

The teaching part of the sequence was accomplished by means of a modified 
recitation procedure In which the Investigator assumed the teacher role. The 
Memory of Classes Instrument was distributed to the subjects and five large 
squares or boxes were drawn on the chalk board. The Instructions and the words 
to be classified In this task are reproduced on the next page. 



1 Guilford, J. P. & Hojjpfnci, ^M^^^iatUire of Intellect Factors and their 

-Tetts, 1966." Aptitudes Research Project Publications, No. 37. University 
of Southern California, Department of Psychology. 
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Ins tructlons: We will work this Item together. Pick out from snong the 
words In the list the five words which you think will make the best head- 
ings under which to categorize other words In the list. Write each head- 
ing-word you decide on at the top of one of the squares below. Now, write 
each of the other words from the list In the square with the appropriate 
heading. Use each word only once. 



irm 11 . 



ARREST 

ATTORNEY 

CONGRESS 

CORRECTION 

COURT 

DETECTION 

ENFORCEMENT 

FINE 

FINGERPRINT 

GUN 

HIGHWAY PATROL 

INVESTIGATOR 

JUDGE 



JUDICIAL SYSTEM 

LEGISLATION 

LIE DETECTOR 

MEDICARE 

POLICEMAN 

PAROLE 

PRISON 

PROBATION 

SENATOR 

STATUTE 

SU5VEILANCE 

TRIAL 



The subjects were asked to read the Instructions from their papers as the 
Investigator read them aloud. Conducting a recitation type Interaction with the 
subjects, the Investigator asked who could pick a word from the list that would 
make a good heading for one of the boxes. The subjects volunteered by raising 
their hands and the Investigator called on them one at a time for suggestions. 
When a suggestion was correct as: predetermined by the scoring key, the Investlga 
tor wrote It In one of the boxes on the chalk board and Instructed the subjects 
to write the word on their Individual answer sheets In the same manner. This 
procedure was continued until all heading words had been Identified and written 
In the appropriate boxes on the chalk board and by the subjects on their own 
papers. Following this step, the remaining words on the list were classified 
under the appropriate headings through a continuation of the recitation type 
Interaction, each word. In turn, being written both on the chalk board by the 
Investigator and on Individual answer sheets by the subjects themselves. The 
Interaction was conducted In an Informal manner allowing for clarification of 
terms and Including the rationale for classification when this appeared to be 
needed. 

When all subjects had written the words on their answer sheets, the sheets 
were collected. The subjects were not Informed that they would be asked to re- 
produce this classification system at a later date.^ 




^ See Appendix Page 66 > for copy of Memory of Classes Item. 
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The Reproduction Phase 

One week alter the Instruction phase described above) at the beginning of 
the data gathering session, the Memory of Classes Instrument was distributed 
again. The investigator asked the subjects whether they had seen the item 
before and reinforced their impression that it was the same list of words they 
had classified Into the boxes on the chalk board the week before. The procedure 
followed in the instruction phase was reviewed— "first , five heading words were 
selected and written at the top of the five boxes; next, each of the remaining 
words was written Into the box with the moit appropriate heading word. When It 
appeared that all subjects had recalled the procedure, the investigator asked 
them to try to remember how the words had been classified and to write them in 
the boxes exactly as they had been written the week before. 

The subjects were given as much time to complete the task as they needed, 
and when all had finished writing all words into the boxes the sheets were 
collected. 



Treatment of the Data 

It was Intended that a subject’s performance on the task would be scored 
on the basis of the number of words classified as they had been classified during 
the instructional phase of the sequence. It became obvious immediately upon 
glancing at the answer sheets that scoring would not be a simple process because 
some subjects did not remember which words had been designated as heading words. 
Therefore, It became necessary as a first step in treating the responses to 
ate some convention for scoring those classes which did not Include one of the 
categories as a heading. The following instructions were prepared for rating 

the responses: 

(a) Inspect the class to see whether a category heading word Is Included 
with at least two other words classified with It In the scoring key. 

If SO, tally the class according to that category. 

(b) If none of the five categories appears as a word in the class but at 
least three words are listed together as in the scoring key, tally 
under the category in which the words are found in the scoring key. 

(c) If a class does not contain at least three words classified as in the 
scoring key, do not tally, because no points are possible. 

A scoring sheet, arranged in five columns was devised. The columns were 
headed: 



Legislation 
Judicial System 
Correction 
Enforcement 
Detection 

Each column was subdivided as on the next page: 
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Heading Word 


Sub-word 


Number of words 


Correct As sub-word 


Number correct 


As heading 


incorrectly 








placed 


( ) ( ) 


C ) 


( ) 


( ) 



By way of illustration, a class consisting of the following words, (COURT, 
ARREST, FINGERPRINT, TRIAL, ATTORNEY) would be tallied under the category Judi- 
cial System with no notation in the heading word column, two words (TRIAL and 
ATTORNEY) as "sub-words correct", one word (COURT) under "sub-word, as heading 
and two words Incorrectly placed (ARREST, FINGERPRINT). 

From such a tally, a count was made of the number of heading words correctly 
designated and of the number of sub-words correctly designated under each cate- 
gory for the entire sample. Since there were fifty-four subjects the maximum 
possible number of correct placements of "heading words" for each category was 
fifty-four. There were four sub-words for each category* For 54 subjects com- 
bined the maximum number of correct placements for sub-words was 216. If all 
subjects had correctly placed all five words In a category the maximum total 
for any category for the sample would have been 270. Table 3-1 below summarizes 
the actual number of words correctly placed as heading words, as sub words, and 
In column 3, the sum of these two columns. In addition, the table indicates t e 
percent of total possible correctly placed and the means per individual subject. 



TABLE 4-1 

SUMMARY OF NUMBER AND PERCENT OF CORRECT PLACEMENTS AND MEAN NUMBER 
REMEMBERED PER SUBJECT ON THE MEMORY OF CLASSES TASK 





Heading Words 
Correct 

Number Percent 


Sub Words 
Correct 

Number Percent 


Combined 
Number Percent 


1 

Mean per 
Sub J ect 


Legislation 


33 


61 


113 


53 


146 


54 


2.7 

0 


Judicial System 


35 


65 


137 


63 


172 


64 




Correction 


37 


69 


135 


63 


172 


64 


3 a 


Enforcement 


41 


6 


127 


S9 


168 


62 


3 a 1. 


Detection 


37 


69 


131 


61 


168 


62 


3 a 1 


Total 


183 


68 


643 

1 — 


60 


826 


61 


15.3 
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Inspection of the table reveals that the word ENFORCEMENT was remembered as 
being a heading word by more subjects than the other four, and LTCI^TI 
remembered by the fewest number, about a 153! difference. Mso, column 
that there were fewer sub words correctly placed In the LEGISLATION 
than In the others. Column 4 of the table shows that slightly 
of the 25 words were correctly placed on the average. It very <1 
Interpret these figures because one cannot know for sure whether subjects who 
placed the words correctly did so because they "reme^ered from the Instruction 
phase or because they "classified" from their knowledge of *=he words and their 

attributes. Examination of some of the responses has ^ 

could not possibly have done so poorly on the task If they had been trying 
classify rather than trying to remember. 



Scoring 

It was possible to make three kinds of errors on the memory of classes task: 
to Include hiding words In a category as a sub word; to 

the heading word; and to place words In the wrong category. A ^ 

was devised In which two points were given for words correctly placed as 
heading words or as sub Joida and one point for words In the appropriate category 
but Incorrectly placed as to headlng/sub word designation. From this i" 

X categMy, Le point was subtracted for each word Incorrectly placed In the 
category. With this formula a score could be obtained for the su ^®® ® °®,®®® 
ca^S and on the total Item. The highest possible score a subject for 
each category was ten points and for the entire Item, fifty points. 



TABLE A-2 



NUMBER OF SUBJECTS ACHIEVING NO POINTS 
EACH CATEGORY AND MEANS AND S. 



OR PERFECT POINT SCORES FOR 
D. FOR EACH CATEGORY 



Points for Individual subjects 



Extremes 



Mean 



(3) 

(A) 



( 6 ) 





Low 


N 


High 


N 


Points 


S.D^_ 


Legislation 


0 


(6) 


10 


(5) 


5.1 

C *7 


2.9 


Judicial System 


0 


(5) 


10 


(10) 


5 # 7 

M A 




Correction 


0 


(10) 


10 


(10) 


5 # 9 


3 # A 

o o 


Enforcement 


0 


(8) 


10 


(8) 


5.3 


3 • 2 


Detection 


0 


(5) 


10 


(8) 


5 • 7 


2 • 9 


Total 


0 


(1) 


50 


(2) 


27.7 


11.8 



Note - The numerals In brackets Indicate the number of subjects who 
achieved the score. 
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Readlng across Row 1, of Table 4-2, we see that for the category of LEGIS- 
LATION, zero points were achieved by 6 subjects, and perfect scores, ten points, 
by five subjects. Mean points on this category 5.1*, S.D. 2.9. The category of 
CORRECTION was apparently most difficult for some subjects, ten receiving no 
points, and the easiest for some subjects, ten receiving perfect scores for the 
category. The mean for the category was 5.9, highest among the five categories. 

Row 6 on the table reports that one subject received no points on the entire 
Item and two subjects received perfect scores of 50 points. These extremes are 
greater than on any task in the entire study. 

Table 4-3 below reports the Intercorrelations between the five categories 
and the total memory score. 



TABLE 4-3 

INTERCORRELATIONS OF CATEGORIES AND TOTAL SCORE ON MBIORY OF CLASSES® 



Variables Notation 



Total Points 




723 


Legislation 


x^ 


— 


Judicial System 


x^ 


518 


Correction 


x^ 


579 


Enforcement 


X^ 


463 


Detection 


x^ 


577 



X2 


X3 


X* 


X5 


828 


780 


708 


818 


518 


579 


463 


577 




295 


437 


354 


295 


... 


478 


619 


437 


478 


... 


488 


345 


619 


488 


— 



® Decimal points omitted. 



Row 1 shows that the five categories contributed about equally to the total 
score. The magnitude of the correlations In this table are not high emo<jiglV to 
give assurance that there Is a memory ability at work which Is more completely 
responsible for the scores than some other factor. The correlations between the 
JUDICIAL category and the other four categories are noticeably lower than most 
of the other Intercorrelations ; with CORRECTION .295, with ENFORCEMENT, .437, 
and with DETECTION, .345, suggesting that performance on this category was less 
dependent on memory from the Instructional phase than was true for the other 
categories. Apparently the words (ATTORNEY, COURT, JUDGE, TRIAL) were known to 
the subjects as related to the JUDICIAL system. The consistently highest Inter- 
correlatlons are with the category of LEGISLATION In which the words to be clas- 
sified Included (CONGRESS, MEDICARE, SENATOR, STATUTE). It may be that the words 
MEDICARE and STATUTE were little known by many students until the instructional 
phase and could have been placed correctly only on the basis of memory. 



Relationships between Memory of Classes Score and Cumulative Record Variables 

Table 4-4 on the next page presents the correlations between the 15 aptitude 
and achievement variables and the Memory of Classes Total Score. It will be 
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noted that 11 of the correlations are significant 



TABLE 4-4 



CORRELATIONS OF MEMORY OF CLASSES SCORES WITH CUMULATIVE RECORD VARIABLES® 



* Significance levels: .269 at .05; .348 at .01; .435 at .001. 

® Decimal points omitted. 



Because of the nature of the task, it is impossible to know the extent to 
which memory from the instructional phase of our procedure influenced the scores 
on the item. On Table 4-4 we find the typically sizable correlations with CAT 
Vocabulary (.518), Reading Comprehension (.470) and Arithmetic Fundamentals (.437) 
The memory ability— memory of words and their attributes— as involved in all 
classification tasks, is undoubtedly involved in this task as well, but nothing 
in Table 4—4 suggests that a Memory of Classes ability was tapped. 

It is probably that our task does not really qualify as a memory of classes 
item because the words included in the item already had meaning for the subjects. 
Some subjects may have been able to do a better job of classifying if there had 
been no instructional phase. As far as we can determine, strict memory of clas- 
ses is appropriate only when groupings are arbitrary — not based on intrinsic com- 
monality. The only excuse we can think of for requiring students to learn mean- 
ingful material as classes so that it can be reproduced as classes, is as an 
interim device during the learning of a complex system of interrelated classes 
when the instructor feels he must use super-ordinate and sub-ordinate terminology 
before the students thoroughly understand the concepts involved or the relation- 



Foints 



Math Grade Point Average 
Reading Grade Point Average 
English Grade Point Average 
Spelling Grade Point Average 
History Grade Point Average 
Total Grade Point Average 
CTMM Language IQ 
CTMM Non- language IQ 
CTMM Total IQ 
Reading Vocabulary CAT 
Reading Comprehension CAT 
Arithmetic Reasoning CAT 
Arithmetic Fundamentals CAT 
English Mechanics CAT 
Spelling CAT 



Total 

371* 

275 

379 

323 
492 
424 
216 
120 
201 
518 
470 

324 
437 
403 
245 



ships between them. 
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On the other hand, If the process of remembering a new name or word for a 
class of Items which Is already meaningful to the learner can be considered 
Memory of Classes, the ability would figure Importantly In Instruction as contrib- 
uting to concept attainment or vocabulary building. 
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COGNITION OF CLASSES 



Definitions 

Cognition: "Immediate discovery, awareness, rediscovery, or recognition of 

Information In various forms: comprehension, understanding." 

Classes: "Conceptions underlying sets of Items of Information grouped by 

virtue of their common property." 

Operational deflnltlon-Cognltlon of Classes: Immediate discovery, awareness 

or recognition of the commonality which Is shared by several Items of 
Information that are presented as a category, set, or class. 



Preparation of Instrument 

To be consistent with the above operational definition, the Items for a 
Cognition of Classes Instrument must Include an array of words which share one 
or more common attributes — which can be seen as constituting a class. The 
Intellectual task for the subject Is to demonstrate that he recognizes or 
comprehends the class. The simplest format, the one used by Guilford In Isolat- 
ing the factor, requires only that a fourth word which does not share the common 
attribute be added to the array of words. The subject demonstrates that he recog- 
nizes or comprehends the class by picking out the word which does not belong. 

The Inventory of words from which the Items were composed was the master 
list of over 400 words written by the eighth grade subjects In response to the 
stimulus topic LAW. College students In the teacher education program who de- 
signed the Items first created a quantity of three-word classes using the words 
In the Inventory. Next, they attempted to find dls tractor words for each Item 
that shared a common attribute, (an attribute different from the one which con- 
stituted the commonality among the original three words) with one or two of the 
original words, but not with all three. 

From among the Items prepared by the college students, eighty were^^selected 
for Inclusion In the Instrument. Sixty Items carried the Instructions Circle 
the word that does not belong" and are referred to In this report as deletion 
Items. Twenty additional Items carried the Instructions, "Pick out the word 
that would make the best heading for the other three." These are referred to 
as PICK-A-Headlng Items. An Instrument of 80 Items was administered to the 

subjects.^ 

Administration of the Instrument 

The Cognition of Classes data were gathered from the eighth grade subjects 



1 Guilford, J. P. & Hoepfner, R., "Structure of Intfellect Factors and P‘elr 

Tests, 1966" Aptitudes Research Project Publications Number 37, University 
of Southern California, Department of Psychology. 

2 See Appendix Pages 67-69/or copy of Cognition of Classes Instrument. 
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on the fourth of five data gathering sessions. In the preceding weeks the 
subjects had completed the DPU, DPC, CPC, and Memory tasks described In the 
preceding sections of this report. 



Analysis of Responses 

Deletion Items: In an effort to discover, In a very general way, how much 

challenge the Items seemed to offer to the subjects, a tally was made of the 
number of subjects choosing a wrong alternative on each Item. The results of 
this tally are reported In Table 5-1 below In the form of a frequency distribu- 
tion. 



TABLE 5-1 



RANGE OF DIFFICULl'Y OF DELETION ITEMS 
ON COGNITION OF CLASSES INSTRUMENT 



Number 


Frequency of 


of Items 


Incorrect Responses 


10 


0 9 


15 


10—19 


17 


20—29 


13 


30—39 


5 


40—49 


TOTAL 60 





This table should be read as follows: Ten of the 60 Items were answered 

Incorrectly by fewer than ten subjects; fifteen Items were answered Incorrectly 
by between ten and 19 subjects, etc. 

No Item was answered correctly or Incorrectly by all subjects. 

By way of Illustration, a few of the Items at the extremes of the continuum 
of difficulty are reproduced In Table 5-2 below. 

TABLE 5-2 

EXAMPLES OF ITEMS AT THE EXTREMES OF DIFFICULT^ 

ON COGNITION OF CLASSES INSTRUMENT 



Item 

// 


Uords In the Item 


Number 
Omit tinfr 


Number 

fifi-f na 


2 


(OUTLAW) (BANDIT) (IN-LAW*) (CRIMINAL) 




0 


1 


4 


(KING) (PEOPLE*) (PRESIDENT) (PRINCIPAL) 




1 


1 


18 


(CONGRESSMAN) XREPRESENTATIVE) (JUDGE*) (SENATOR) 


2 


2 


44 


(ANARCHY*) (DEMOCRACY) (COMMUNISM) (TYRANNY) 




2 


46 


60 


(AWARD) (DELIBEPATE*) (JUDGMENT) (SENTENCE) 




2 


47 


17 


(AMENDMENT) (BILL OF RIGHTS*) (LAW) (STATUTE) 




0 


46 


* Correct answer 
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A cursory examination of the Items In the table which were answered Incor- 
rectly by such a large number of subjects raises the question as to whether the 
fault lay with the Items themselves rather than with the eighth graders. An 
inspection of the answer sheets of the subjects who scored highest on the entire 
Instrument revealed that they had answered the Items correctly more often than 
the subjects who scored lowest on the Instrument, but the differences were not 
great. Our Impression, after having studied the responses of the subjects to 
the Items, was that many of the Items could have been Improved. 

PICK-A-HEADING Items: Twenty Items were selected for the Instrument which 

Instructed the subject to pick one of the four words that would make the bes* 
heading for the other three. By way of Illustration, Item number 18, from the 
Instrument, la reproduced below. This Item was answered Incorrectly by 32 
subjects: 



18. ASSEMBLYMAN 
LEGISLATOR* 

REPRESENTATIVE 

SENATOR 

No Item was answered correctly or Incorrectly by all subjects. 



Scoring 



One point was assigned to each Item answered correctly. The scores were 
recorded on the two kinds of Items separately and combined for a total score for 
each subject. The scores for the sample are summarized on Table 5-3 below. 



TABLE 5-3 

SUMMARY OF SCORES FOR THE COGNITION OF CLASSES INSTRUMENT 



// of Points 



Type of Item Possible Extremes Mean SD 







Low 


High 






DELETION 


60 


21 


51 


33.6 


5.6 


PICK-A-HEADING 


20 


5 


20 


15.4 


2.5 


TOTAL 


80 


33 


70 


49.0 


7.1 



It will be noted that the subjects seemdd to find the PICK-A-HEADING Items 
easier than the DELETION Items. To the extent that this reflects a real rather 
than a chance difference In the difficulty of the two types of Items It could be 
accounted for by the fact that the PICK-A-HEADING Items Include more cues than 
do the DELETION Items. One could not predict the existence of such a difference 
In difficulty on the basis of these sparse data, but might do so on the basis of 
the nature of the Items themselves. The DELETION Items give no clue whatsoever 
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as to the kind of attribute three of the words have in common while the PICK-A- 
HEABINS instructions may suggest to the subject that the attribute is one of 
level of abstraction. The coefficient of correlation for the two parts is .539. 
The coefficient of correlation for the DELETION score with total score was 
reported as 1.00 which appears from an inspection of the actual scores to be 
somewhat in error. The correlation of total score with PICK-A-HEADING was .840. 

Again, as was the case with Convergent Production of Classes, it appears as 
though when one tampers with the format used by Guilford in isolating the factors, 
he runs the risk of changing the Structure of Intellect product with which he is 
dealing. 



TABLE 5-4 

CORRELATION OF COGNITION OF CLASSES SCORES WITH 
CUMULATIVE RECORD VARIABLES® 





Deletion 


Pick-A-Heading ' 


Total 


Math GPA 


519 


386 


550 


Reading GPA 


402 


228 


443 


English GPA 


427 


297 


481 


Spelling GPA 


337 


064 


320 


History GPA 


628 


435 


686 


Total GPA 


550 


308 


603 


Language IQ 


1 277 


269 


259 


Non- language IQ 


1 -024 


-063 


-096 


Total IQ 


1 200 


103 


091 


CAT Reading Vocabulary 


440 


549 


482 


CAT Reading Comprehension 


635 


522 


612 


CAT Arithmetic Reasoning 


393 


303 


388 


CAT Arithmetic Fundamentals 


437 


298 


453 


CAT Engllf’h Mechanics 


160 


213 


158 


CAT Spelling 


071 


040 


000 

i 



® Decimal points are omitted. 

Significance levels; .269 at .05; .348 at .01; .435 at .001. 



Table 5-4 above, presents correlations between the two types of cognition 
items, the total score and the variables from cumulative records, atten- 

tion first to a comparison of the magnitude of the correlations of the two types 
of Items and the cumulative record variables, we see that in all but one Instance 
the DELETION scores correlate higher. The one exception to this is the correla- 
tion of .549 with PICK-A-HEADING and CAT Reading Vocabulary. Consistently 
throughout the data in this report, we find that as the classification items 
are altered to include more cues correlations with vocabulary go up, suggesting 
that we have, to an extent, made our items more nearly SI Units (vocabulary) and 
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less clearly SI Classes. 

Of the 45 correlations In the array on Table 5-4, 30 are significant and 
several «re impressive, indicating that Cognition of Classes, as this 
Ls tapped the ability, is related to achool achievement. T^e meaning of these 
correlations will be discussed in a subsequent section of this report in which 
the several SI Operations are compared. 



This is an extremely Important point, 
exercises to elicit classification 
cues. Evidently when they do, the 
task is lost. 



College students and teachers who design 
behavior seem compelled to include many 
special potential of the classification 
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EVALUATION OF CLASSES 



Definition! 

Eveluetlon! "Reaching decisions or asking Judgment! concerning criterion estle- 
factlon (correctnes!, suitability, adequacy, desirability, etc.) of Informa- 
tion. 

Classes: "Conceptions underlying sets of items of Information grouped by virtue 

of their common property,"^ 

Operational deflnltlon-Evaluatlon of Classes: When the commonality shared by a 

set of Items is designated as the criterion, make a judgment as to which of 
two alternative choices best satisfies the criterion, i.e., best fits into 
the set. 



Preparation of the Instrument 

The Operational definition for Evaluation of Classes specifies that the 
crlterj#n to be used In the making of judgments about classes Is to be the attri- 
bute shared by the Items In a class— the jmmon attribute shared by a set of 
Items. Once this decision Is made, one realizes that. In a sense, most of the 
classification tasks devised for this study Involve evaluation of classes— using 
a common attribute as a criteria for making judgments. Since the emphasis in 
this phase of data gathering was to be on the criterion , rather than on the 
judgment , a technique was utilized which required the subject to articulate the 
criterion on which his classification dec^.sions were based. ^ 

Using the words originally associated to the stimulus topic LAW by the 
eighth grade subjects, college students prepared a quantity of items. Each item 
consisted of a three-word class together with two alternative words from which 
the subject was to make a judgment as to which fit better with the other three 
to make a good class or category. An excunple from the Instrument is reproduced 
below. 



1. LAWYER (A) COURT REPORTER 

JUDGE (B) JURY BOX 

BAILIFF 

Following the making of the judgment, the subject was asked to communicate 
the reasons for his choice. The Instrument consisted of 50 Items. Consistent 

Guilford, J. P., & Hoepfner, R. , "Structure of Intellect Factors and Their 

Tests, 1966." Aptitudes Research Project Publications, Number 37, University 
of Southern California, Department of Psychology. 

2 In retrospect. It appears as though our Items for the operation of Evaluation 
should have required the subject to make a judgment as to which of two 
classes was better. One of each pair could have Included itcsss which more 
nearly satisfied the criteria for a good class described in the section of 
this report dealing with Divergent Production of Classes-Quallty. 

^ See Appendix Page 70, for a copy of the Evaluation of Classes Instrument. 







with our »tt«mpt to ewph»fci*® the crlfrlon undtrlylng c»ch choice, the inter- 
view technique wee ueed in deta collection. 



Date Collectlon-Irterviewe 



The interviews were conducted by the college students who had been involved 
in building the instruments utilized in previous phases of this study. The data 
were gathered in two sessions. One-half of the subjects were interviewed during 
one hour by one group of interviewers and the other half of the subjects were 
interviewed immediately following by a second group of interviewers. One inter- 
viewer and one subject occupied a double desk in a large classroom. Thus, 
approximately 27 Interviews were being conducted in the same classroom at the 
same time. 

The subject and the interviewer each had a copy of the items. In addition, 
the interviewer had an answer sheet on which to record the subject's responses. 
The interviewers read the three words in the item aloud as the subject studied 
the printed item. Then the interviewer asked, "Does (A) COURT REPORTER, or (B) 
JURY BOX, fit best with these other three words to make a four-word category?" 

If the subject seemed to be reluctant to make a judgment, the interviewer encour- 
aged him to try even If he wasn't sure of the answer. After the subject had made 
his choice between the alternatives, the interviewer asked him to give the rea- 
sons for his choice; "Can you tell me why you chose that one?" The subject's 
response was recorded verbatim on the interviewer's answer sheet, and if the 
interviewer felt there was reason to do so, he would probe with the standard, 
"Tell me a little more about it." 



Treatment of the Data 



In order to be able to assess the effectiveness of the technique with 
eighth graders and to get some feel for how the items themselves worked out, 
each answer sheet was treated as follows. For each item, the following notations 
were made; (a) Judgment attempted or not; (b) judgment correct or Incorrect; 

(c) acceptable criterion statement present or absent. A sheet was prepared 
on which the above information about the items could be tallied and summarized 
and percentages calculated. With such information it was possible, in addition^ 
to compute a "Criterion Difficulty" score for each item. This information is 
reported in Table 6-1. By wa'» of illustration, the figures describing item "1" 
from the Instrument would be Interpreted as follows; Item "1". Number making 
a judgment, 54 (lOOX); Correct choices, 42 (78X of those attempting); Acceptable 
criterion present, 31, (74% of number making correct choice); Criterion Difficul- 
ty, percent of persons making correct judgment who supplied acceptable criterion 
statement subtracted from 100% (100 - 76 - 26). Twenty-six percent of the sub- 
jects who made the correct judgment were unable to supply an acceptable criterion. 



47 



TABLE 6-1 



DIFEICOLTY LEVEL OF 


ITEMS ON EVALUATION OF 


CLASSES 


INSTRUMENT 




(1) 






(2) 


<3) 




(4) 




Subjects 




Correct 


Acceptable 


Criterion 




Making 




Judgments 


Criterion 


Difficulty* 




Judgments 






Statement ^ 




Item 








X of 




X of 




NuBibAir 


N 


X 


M 


attempts 





correct 




1 


54 


100 


42 


78 


31 


74 


26 


2 


52 


96 


43 


83 


33 


77 


23 


3 


54 


100 


53 


98 


48 


90 


10 


4 


52 


96 


48 


92 


36 


69 


31 


5 


50 


93 


11 


22 


21 






6 


50 


93 


40 


80 


27 


68 


32 


7 


48 


89 


44 


91 


39 


89 


11 
J A 


8 


47 


87 


44 


94 


23 


52 


48 


9 


53 


98 


44 


83 


31 


70 


30 


10 


45 


83 


44 


97 


10 


23 


77 


11 


52 


96 


42 


81 


33 


79 


21 


12 


50 


93 


47 


94 


35 


74 


26 


13 


49 


91 


47 


96 


21 


45 


55 


14 


48 


89 


39 


81 


21 


54 


46 


15 


46 


85 


35 


76 


27 


77 


23 


16 


44 


81 


37 


84 


29 


78 


22 


17 


46 


85 


45 


98 


37 


79 


21 


18 


38 


70 


36 


95 


11 


31 


69 


19 


44 


81 


24 


55 


21 


88 


22 


20 


42 


78 


31 


74 


22 


71 


29 


21 


43 


80 


25 


58 


7 


28 


72 


22 


38 


70 


33 


87 


25 


76 


24 


23 


29 


54 


28 


97 


18 


64 


36 


24 


28 


52 


18 


64 


3 


17 


83 


25 


26 


48 


17 


65 


17 


100 


0 


26 


25 


46 


20 


80 


5 


25 


75 


27 


19 


35 


10 


52 


9 


90 


10 


28 


17 


31 


10 


59 


2 


20 


80 


29 


15 


28 


9 


60 


3 


33 


66 


30 


13 


24 


13 


100 


7 


54 


46 


31 


12 


22 


7 


58 


3 


53 


47 


32 


10 


19 


7 


70 


3 


53 


47 


33 


8 


15 


7 


87 


6 


86 


14 


34 


5 


9 


3 


60 


0 


0 


100 


35 


5 


9 


3 


60 


2 


67 


33 








TOTAL 


2709 




2054 


1355 








MEAN 


77X 




60Z 


39Z 



* Percent In column 3 subtrected from 100* 



-48 



The first column In Table 6-1 Illustrates why It was necessary to use 
”p«J^cent correct of items attempted" in our descriptions of item difficulty. 

Column 1, shows that the percentage of subjects attempting the items remained 
fairly constant through item //22. Thereafter, the percent attempting the item 
declines consistently suggesting that time was « limiting factor. 

Summarizing from the Information on Table 6-1, but without much attention 
to detail, several generalizations can be made about the items. First, the cor- 
rect alternatives in the items were rather easy to spot for the eighth grade 
subjects. On the average, 77% of their Judgments were correct, and on only one 
item did the percent of torrect choices fall below 50. Second, it was difficult 
for the subjects to articulate an acceptable rationale even for Judgments which 
were correct. On the average, they could supply acceptable statements of criteria 
for only 60% of their correct Judgments. Third, the Items differed greatly one 
from another in the difficulty subjects found in stating acceptable criteria. 

On item //lO, for example, 77% of the subjects who made correct Judgments could 
supply no acceptable rationale for their Judgments, while on item //25, all sub- 
jects who made the correct Judgment were able to supply acceptable criteria. 



Scoring 

A subject’s total score was based on the number of correct Judgments plus 
the number of points assigned to his statements of criteria. Criteria state- 
ments were scored "2" points for good statements, "1" point for fair statements, 
and "0" points for statements considered to be Inadequate. Two examples follow. 

Item 1. LAWYER (A) COURT REPORTER 

judge Cb) jury box 

BAILIFF 

Statement of Criterion: 

"0" Points - "All are in a court room." 

"1" Points - "These are people." 

"2" Points - "People who have special Jobs to do in a trial." 

Item 33. PARDOH (A) OUT ON BAIL 

parole (B) suspended SENTENCE 

PROBATION 

Statement of Criterion: 

"0" Points - "Suspended sentence seems to fit better." 

"1" Points - "Out of prison." 

"2" Points - "Free after conviction." 

A maximum of three points could be earned for a single item— one point if 
the correct Judgment was made plus one or two points for the criterion. 

Each subject’s protocol was treated to yield seven scores as follows: 

(1) Number of items attempted; (2) Number of correct choices; (3) Number of cor- 
rect choices supported by criterion points; (4) Number of correct choices unsup- 



ported by criterion points; (5) Total criterion points; (6) Total score (which 
represents the sum of correct judgments plus the total criterion points); and 
(7) Mean points per item, computed by dividing the total score by the number of 
Items attempted. 

These data are summarized for the sample on Table 6-2 below. 



TABLE 6-2 

SUMMARY OF SCORES ON EVALUATION OF CLASSES INSTRUMENT 







Extremes 
Low High 


Mean 


SD 


(1) 


Number of Items 
attempted 


11 


35 


23.3 


5.8 


(2) 


Number of correct 
choices 


6 


29 


18.6 


5.0 


(3) 


Number of correct 
choices with criterion 
points 


4 


20 


12.5 


4.2 


(4) 


Number of correct 
choices without 
criterion points 


2 


18 


6.1 


3.4 


(5) 


Total criterion points 


6 


35 


20.5 


6.7 


(6) 


Total points 


12 


59 


39.1 


11.0 


(7) 


Mean points per item 


0.71 


2.24 


1.7 


.3 



Table 6-2 shows some Interesting differences In style within this group of 
eighth graders. In row 1, the slow or fearful child who Is willing to attempt 
only eleven Items and the uninhibited or confident child who breezes through 35 
items in the same period of time. In row 2, we see a child who makes only six 
correct judgments although, as we have shown in our Item analysis, the Items are 
quite easy for most of the subjects. Of most Interest, however. Is row 4, in 
which we see one child getting 18 correct judgments for which he is unable to 
give acceptable statements of criteria, and row 5, in which a child, on the entire 
task is able to supply statements of criteria judged to be worth only six points. 



Comparison of Evaluation of .Classes Scores to Cumulative Record V ariables 

Correlations between the Evaluation of Classes scores and the cumulative 
record variables are reported In Table 6-3 on the next page. 
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TABLE 6-3 

CORRELATIONS OF SCORES ON EVALUATION OF 
CLASSES WITH CUMULATIVE RECORD VARIABLES® 



(1) (2) (3) (4) (5) (6) (7) 

// Items # Items # Correct// GorrectTotsl Total Mean 
Attempted Correct ifith without criteria points 

Criteria criteria points points per item 



(l)Math 6FA 


056 


153 


328 


-182 


308 


267 


159 


(2)Readlng GFA 


044 


030 


249 


-224 


270 


198 


141 


(3)Engllsh GFA 


-036 


-020 


217 


-276 


228 


144 


104 


(4) Spelling GFA 


-099 


-089 


102 


-271 


182 


078 


174 


(5)Hlstory GFA 


181 


188 


324 


-097 


357 


318 


136 


(6)Total GFA 


051 


046 


280 


-225 


281 


230 


174 


(7) Language IQ 


-230 


-030 


199 


-303 


253 


028 


213 


(8)Non-language IQ 


-107 


022 


049 


-047 


013 


-041 


-045 


(9)Total IQ 


-193 


000 


125 


-185 


131 


029 


086 


(lO)CAT Read Vocab 


123 


211 


269 


-041 


365 


255 


195 


(11) CAT Read Compre 


-017 


064 


265 


241 


355 


226 


282 


(12) CAT Arlth Reas 


149 


127 


224 


-093 


193 


189 


005 


U3)CAT Arlth Fund 


072 


063 


260 


-218 


288 


212 


073 


(14)CAT Eng Mech 


-298 


-268 


-013 


-396 


033 


-124 


073 


(15)CAT Spelling 


-386 


-358 


-128 


-384 


-028 


-216 


092 



^Decimal points omitted. 

Significance levels: .269 at .05; .348 at .01; .435 at .001. 



Three of the columns in Table 6-3 are particularly instructive. Columns 
1, 2, and 4, all reflect volume of output; all have a number of negative coef- 
ficients; and all are based entirely on the making of a simple two-altematlve 
judgment — selecting alternative A or B in the Evaluation of Classes Instrument. 

It would appear that the task designed to elicit evaluation behavior has been 
relatively successful as a device for allowing the opposite tendency to manifest 
Itself. Columns 1 and 2 reflect correlations with Evaluation of Classes scores 
In which quantity of output contributes to the score and ability to supply cri- 
teria may or may not be present. Column 4, on the other hand, reflects correla- 
tions- with Evaluation of Classes scores In which the Judgment was correct, but 
criterion points were missing. In this column all correlations are negative 
(many significantly so), except for a correlation with CAT Reading Comprehension 
(.241). We can only speculate that tasks which allow a subject to answer with a 
”thls or that*' "yes or no" answer may be one way of allowing the typically poor 
student to demonstrate some ability. Its strength, If Indeed It has any, may 
lie In the hope that through having made a correct Judgment In this rapid fire 
kind of task, such pupils gain a little respect for themselves. 

Reading across the table In rows 14 and 15, we see negative correlations 
with CAT English and CAT Spelling In nearly all columns. These negative correla- 
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tlons obtain to some extent with all scores except those In which quantity of 
output la either nullified as In column 7 (Mean Points per Item) or minimized 
in column 5 (Total Criterion points). To the extent that these correlations 
represent a real relationship between the variables, one could hypothesize that 
whatever personality ot Intellectual characteristics contribute to making judg- 
ments quickly apparently are antithetical to the kinds of characteristics re- 
quired to master English Mechanics and Spelling. 



When we turn our attention to column 5 . (Total Criterion points) , we find 
a rather dramatic shift from negative to positive correlations. It will be 
recalled that the Total Criterion point score includes only the points assiped 
for the criterion statements and does not include a point for having made the 
correct judgment on the items. Quantity of output influences the score only as 
the subject is able to attempt a greater number of items for which he can sup- 
ply criteria to support his judgments. We can see that this distinction is 
important by comparing the correlations in this column, column 5, to those in 
column 7 (Mean points per item) where quantity has been ruled out entirely. In 
column 7, the correlations are mostly positive, but none reaches significance. 
The difference between these two columns can be summarized by saying that the 
ability to make judgments and supply acceptable criteria for * 
ments is more apt to be related to school achievement than is the tendency t 
confine oneself to making only those judgments for which one can make especially 

good statements of criteria. 

The .blllty to supply ecceptable statements of criteria to • 
large number of Judgments Is related to erade point average In math and history 
and to achievement test scores in Reading Vocabulary, Reading Comjirehension, and 
to Arithmetic Fundamentals. 



Turning attention to column 6 on Table 6-3, we find that the 
score, which Includes both criteria points and points for number 
ments, does not correlate significantly with any variable except History GPA. 

By way of summary. It appears as though the Evaluation of Classes task 
devised for this study was poorly conceived except as It 

problems Inherent In the very process of making Judgments. reason-’^ 

Lkes Judgments quickly, he may find that he cannot defend them with a rewon 

able ratlmale even when they are correct. It may be, for , 

this kind of pattern Is established, the teacher s effort should after 

a kind of exercise In which the pupil's Judgment must be P09tP0"®d 
he has forced himself to articulate the criterion on which J°^® 

For E'.-aluatlon of Classes, this might mean presenting Items of InforMtlon 
grouped together, asking the student to specify what the grouping “Iterlra 
appears to be, and then asking him to make a Judgment as to which of the two 

alternatives best fits the criterion. 
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THE OPERATIONS COMPARED 



In preceding sections of this report, each operation has been discussed 
Independently and all except DPC-Quan have been shown to be related to school 
achievement. Certain scores from the various Instruments described In the 
previous section have been selected for use In this section because they ap- 
peared to be relatively less dependent upon vocabulary or because they appeared 
more nearly to be consistent with Structure of Intellect definitions. Inter- 
correlatlons among these selected scores from among the classification Instru- 
ments are reported In Table 7-1. 



TJ BLE 7-1 



INTERCORRELATIONS AMONG THE SEVERAL OPERATIONS 



Variable 


Notation 


xi 


X2 


X3 


X^ 


X5 


(1) Divergent Prod. Classes-Quan 


xi 


— 


.032 


.014 


.055 


.012 


(2) Convergent Prod, of Classes- 
Llst Division 




.032 


— — 


.302 


.173 


.282 


(3) Cognition of Classes-Total 


x^ 


.014 


.302 


— 


.443 


.452 


(4) Memory of Classes-Total 


x^ 


.055 


.173 


.443 


— 


.246 


(5) Evaluation of Classes- 
Crlterlon Points 


X5 


.012 


.282 


.452 


.246 





All correlations on the table are positive. In the first row, we see that 
DPC-Quan apparently Is not related to any of the other scores, a fact which 
leaves us with a very serious question as to whether the task utilized In this 
study, when scored only for quantity. Is a measure of the product, classes. We 
may say parenthetically that there Is evidence In the data, not discussed else- 
where In this report, that the DPC-Quan score Is a measure of Divergent Production 
since It correlates substantially (.554) with the Divergent Production of Units 
score (the total number of words written by the subject In response to the topic 
LAW) . We can conclude from the correlations on Table 7-1 that DPC-Quan Is unre- 
lated to any other classification ability measured In the study. 



The Cognition of Classes score In row 3, on the other hand. Is correlated 
significantly with all classification tasks except DPC-Quan, suggestie^ that the 
ability to cognize classes Is basic to all classification when quality Is con- 
sidered. All other correlations on the table are between .173 and .282. This 
array of Intercorrelatlons lends support to the generalization that classifica- 
tion ability, regardless of the operation utilized to elicit It, rests first on 
the ability to recognize, grasp or comprehend a class. Beyond this, the opera- 
tions are relatively Independent of one another . 



o 
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It may be instructive to bring together into one table an array of correla- 
tions which makes it possible to compare the magnittade of the correlations 
between the several operations and selected variables from the cumulative records. 
Table 7-2 presents such an array. 



TABLE 7-2 

CORRELATIONS BETWEEN THE SEVERAL OPERATIONS AND SELECTED 
VARIABLES FROM THE CUMULATIVE RECORDS® 







(1) 




W 


(4) 


(5) 


kb) 






CPC 












DPC 


List 






L 


DPC 




Ouan 


nn 


Cng. . 






Q»<>1 


(1) CIMM Non-lang. IQ 


049 


067 


-096 


120 


013 


229 


(2) CTMM Language IQ 


007 


180 


259 


216 


253 


451 


(3) CTMM Total IQ 


071 


191 


-091 


201 


131 


403 


(4) Math GPA 


136 


253 


550 


371 


308 


306 


(5) English GPA 


205 


338 


481 


379 


228 


176 


(6) History GPA 


142 


269 


686 


492 


357 


379 


(7) CAT Reading Vocab. 


083 


314 


482 


518 


365 


461 


(8) CAT Reading Comp. 


023 


392 


612 


470 


355 


351 


(9) CAT Arlth. Reas. 


001 


451 


388 


324 


193 


40/ 


(10) CAT Arlth. Fund. 


007 


522 


454 


437 


288 


321 


a. Decimal points omitted 


a 












b. Total criterion points 


• 












Significance levels: .269 at 


.05; .348 


at .01; 


.435 at 


.001. 





Beginning with row 1, we see that no classification task devised for the 
research correlates significantly with Non-language IQ. The only classification 
score which correlates with IQ is the D?C-Qual (5 point classes) which correlate 
with both Language IQ (.451) and Total I.Q. (.403). Rows 7 and 8 on the table 
are instructive. All classification abilities except DPC-Quan correlate signifi- 
cantly with CAT Reading Vocabulary. The highest of these Is with Memory of Clas- 
ses, (.518). All classification abilities except DPC-Quan also correlate sig- 
nificantly with CAT Reading Comprehension. The highest of these correlations 
is with Cognition of Classes, (.612). The CAT Arithmetic scores, columns 9 ana 
10, correlate significantly with most classification scores. The highest cor- 
relations for both are with Convergent Production of Classes-Llst Division. 
Columns 5, 6, and 7 indicate that the Cognition of Classes ability correlates 
highest with GPA In Math (.550), in English (.481), and in History (.686). 

Since Cognition of Classes correlates highest with Grade Point Average it 
may be instructive to compare the magnitude of these correlations with correla- 
tions between these same measures of school achievement and standardized apti- 
tude and achievement measures. Table 7-3 presents these data on the next page. 
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TABLE 7-3 



CORRELATIONS BETWEEN TEACHERS" GRADES AND SELECTED MEASURES 



Grade Point 
Average 


(1) 

CTMM 


(2> (3) (4) (5) 

California Achievement Test 


(6) 

Cod 

of"* 


Total 

IQ, 


Reading 

Vocab 


Reading 

Comp 


Arlth 

Reas 


Arlth 

Fund 


Mathematics 


.425 


.410 


.574 


.371 


.557 


.550 


English 


.340 


.4/-9 


.432 


.283 


.608 


.481 


History 


.347 


.585 


.618 


.483 


.602 


.686 



Comparing the correlations In column 1, with those In column 6, we find 
that the Cognition of Classes task devised for this study correlates higher 
with teachers* grades In mathematics, English and history than does I.Q. Read- 
ing across the first row In the table, we find that Cognition of Classes cor- 
relates very nearly as well with GPA In math (.550) as does Arithmetic Fundamen- 
tals (.557) and better than does Arithmetic Reasoning (.371). CAT Reading 
Comprehension correlates higher with Math GPA (.574) than does Arithmetic Funda- 
mentals (.557) or Cognition of Classes (.550), but the differences are not great. 
Attention to teachers* grades In English Is also Interesting. Here we find CAT 
Arithmetic Fundamentals correlating higher (.608) than does Reading Vocabulary 
(.449) or Reading Comprehension (.432). Cognition of Classes correlates higher 
with English GPA (.481) than does either the Reading Vocabulary or Reading 
Comprehension score. Cognition of Classes correlates highest of any measure 
with GPA In history. Next In magnitude with history grades Is Reading Compre- 
hension (.618) followed by Arithmetic Fundamentals (.602). 

These persistent correlations between teachers* grades, Reading Comprehen- 
sion, Reading Vocabulary, and Cognition of Classes have led us to attempt an 
analysis of the Classification ability Itself. It Is Interesting to ponder why 
the ability to do arithmetic computation should be related to classroom achieve- 
ment In English and why, on the other hand, the ability to classify simple words 
about LAW should be related to achievement In math. Following Is our analysis: 

The Cognition of Classes tasks devised for this study presented the subject 
with four words, all having originally been associated to the word LAW, three 
of which shared a common Intrinsic attribute and/or a common level of abstrac- 
tion and/or a similar subordinate position to a common heading. The fourth word 
of the array related In one way or another to one or more of the words constitut- 
ing the category, but not to all three. The task of the subject was simply to 
circle the word that did not belong. 

In order to accomplish this task, the subject must first have attained the 
concepts presented by each word In the array to the extent of being aware of the 
relevant attributes— the attributes which served as the basis of the category 
built Into the Items. This accounts In a rough way for the Importance of vocabu- 
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lary or concept attainment to the classification task* Assuming that the sub- 
ject has adequate concepts for the task, he must resist the temptation to 
respond on the basis of a hypothesis that occurs to him before the relevant 
attributes of all the words have come Into awareness and are available for the 
task. Then he must engage In search behavior or hypothesis testing until he 
discovers the commonality that Is shared by three but not by the fourth In the 
array. 

Vocabulary or mature concepts are necessary to, but not sufficient for the 
classification tasks. Even If the subject has a concept which he can utilize 
readily In Its most common context, he cannot utilize It effectively In a clas- 
sification task unless he can abstract Its attributes and Inhibit the tendency 
to respond until he has matched the abstracted attributes of all words In the 
array and found the relevant categories. In short he must analyze— tell himself 
all he knows about the stimulus words and be sure he understands the nature of 
the problem before he proceeds. 

This description of the classification task parallels In many ways the des- 
cription of the behavior of the effective problem solver In math. There may be 
many parallels also between this process and that Involved In reading comprehen- 
sion— the knowledge of concepts, and the ability to resist the temptation to move 
ahead before one has allowed oneself to understand what one knows about the con- 
cepts and relationships being spelled out on the printed page* 

To the extent that this analysis has validity. It offers some explanation 
for the remarkable relationships among cognition of classes, Reading Comprehen- 
sion, and school achievement In math and English. In addition. It gives some 
support to the Struct^’-e of Intellect theory which postulates a classifying 
ability that operates across content boundaries and Involves more than the 
knowledge of the units being classified. More Importantly, however, the analysis 
suggests the possibility that classification tasks using words and meanings may 
serve as a vehicle for the development or Improvement of an analytic approach to 

learning . 
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SUMMARY, CONCLUSIONS, AND INTERPRETATIONS 



This paper describes a study designed to Investigate the abilities of 
Junior high school pupils to classify semantic Information according to the 
operations hypothesized by the Structure of Intellect model. The study was 
undertaken In an attempt to gather data with which to assess In very general 
terms; whether the practice of using the Structure of Intellect In the prepara- 
tion of teachers both as*'a description of Intellect and as a taxonomy of 
educational objectives Is sound. 

The soundness of the practice rests both on the practicality of expecting 
teachers to be able to design techniques and questions with which to elicit 
many different kinds of Intellectual behavior and on the validity of the model 
as a taxonomy of educational objectives. The techniques and procedures used 
In this study were designed as a kind of example of how a teacher might go about 
eliciting classification behavior In his own classroom with his own pupils and 
with his own subject matter, A teacher using the techniques and procedures In 
connection with his own teaching would select a stimulus topic central to his 
own subject-'matter and would design classification Items relevant to concepts 
Important to curricular goals, and he would use the student’s responses for 
Instruction rather than for measurement. The study was undertaken on the as- 
sumption that If college students can design Items that successfully elicit 
five kinds of classification behavior from school age children under the condi- 
tions Imposed by the research design. It Is reasonable to assume that they could 

do so in a real teaching setting. 

The validity of the model, as far as this study Is concerned, rests with 
whether It Is Important or desirable for a teacher to call upon his students 
to classify. Is there, for example, something about the act of classifying 
that Is especially relevant to the goals of education, and If so, is It 
worthwhile to call for classification behavior from students using several rather 

than only one or two operations. 

We Interpret the findings reported In the previous pages of this report 
as lending support to both premises: (1) that It is practical to expect teach- 

ers to be able to elicit classification behavior from their students; and (2) 
that It Is desirable for them to do so. 

Relevant to the practicality Is the fact that. In a very brief space of 
time, college students designed the Items utilized In this study. Items designed 
to stimulate classification behavior using five different operations apparently 
did elicit the five operations to some extent. In an effort to Introduce 
novelty Into the classification tasks a variety of Items were devised. These 
were more time consuming to design than the relatively straight-forward tasks 
used my Guilford, and they were less effective. The tasks devised for tha 
study which were easiest to design were also the most effective. 

Many of the findings lend support to the desirability of calling upon 
students to classify. First, classification ability Is related to achievement 
In such seemingly diverse subject matters es methemetlcs end history And Is 
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related, also, to vocabulary and reading comprehension. It Is not possible 
from the nature of our findings to separate cause and effect In these rela- 
tionships, but this does not lessen the Importance 6f the fact of the rela- 
tionship. Our analysis of the classification behavior of subjects In this 
study suggests that such tasks demand a kind of analytic behavior— thinking— 
which Is Involved In many ways In problem solving behavior In mathematics, 
with symbolic content, but which Is much less frequently demanded with semantic 
material. Given a group of words or concepts to classify, the subject must pay 
attention to the attributes of the words — must see more than the most obvious 
or common characteristics of each one and then must search for commonality 
among them. It Is of little moment to the teacher whether increasing a student's 
Interest In words and their attributes will result In Improved ability to clas- 
sify or whether Improved ability to classify will Increase the student's Inter- 
est In words. Anything that '•'esults In Increased Interest In concepts and their 
attributes will pay off handsomely for the student. This study has demonstrated 
many ways In which classification tasks can be used to contribute toward such a 
goal. 



Second, the findings lend support to the use of the several operations In 
stimulating classifying behavior rather than relying on just one. The analysis 
In turn of each of the five operations has brought insights Into the nature of 
this complex entity called intellect. For example, the classes produced by the 
subjects from scratch In the Divergent Production of Classes task demonstrated 
both the difficulty and the challenge of so seemingly simple a task. The Conver- 
gent Production of Classes Items suggested that supplying cues as to the nature 
of the class built Into the Item dilutes their potential. The Memory of Classes 
procedure reminded us that attem*^ «s to remember something as complex as a system 
of classes may actually Interfere with thinking behavior. The Evaluation pro- 
cedure demonstrated the effects of making hurried judgments before rather than 
after applying the criterion on which the judgment Is to be based. 

In addition to learning about Intellect from studying the responses produced 
by subjects to the various operations, the teacher can learn about the differences 
among students. Our study demonstrated that the correlations among four of the 
operations are not high, even though In all operations the product and the content 
were the same— semantic classes. Individual youngsters In our sample showed 
Idlocyncratlc patterns In terms of the operations— one performing especially 
well on Convergent Production of Classes, a second demonstrating unusual ability 
on Evaluation of Classes, and so forth. ^ We cannot say from this one sample of 
behavior whether or not such patterns would persist. If It were to be shown that 
they do, a teacher could readily learn how to arrange for individual youngsters 
to have genuine success experiences In school. 

In short, many findings from this study can be Interpreted as lending sup- 
port to the continued use of the Structure of Intellect In the professional 
education of teachers both as a description of Intellect and as a taxonomy of 
educational objectives at least for the facets of the model Investigated In this 
research. 



l.See Appendix, Page 7d> Table 8, The Placement by Stanlnes of the Fifty-Four 
Subjects on IQ, GPA, and the Classification Tasks. 
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DIVFHGBNT PRODUCTION OF UNITS 



Instructions: On this sheet, write down all the wor.is or ideas Lnat come to 

your rnin^ ~ i;me n you think of the word UW. If an idea that comes to year mind 
includes the word "law", such as "law school", write both words. 

Try to avoid losing contact with the topic LAW. For example, you may 
think of the word, "uniform" because policemen wear uniforms. You siiould write 
the word "uniform" on your paper, but if the word uniform makes you tainK of 
the word "inform" because they sound alike, don't write the word inform , but 
start again with the word, "law" . 

Write as many words at you can in the ten tinutes allowed. If you don't 
know how to spell a word, do the best you can, or raise your hand and we will 
help you with the spelling. If you still have words you want to write when we 
call "time", write the word "time" on your paper. If you run out of space, 
continue your list on the back of this sheet* 




LAW 



1 . 




9 . . 

10 . 
11 . 
12 . 
13. 
lU. 



19. 

16 . 

17. 




20 . __ 
21 . _ 
22 . __ 
23 . _ 
2U. _ 

26. _ 

27 . „ 

28 . _ 

29 . . 

30. . 
31* - 

32. _ 

33* . 

3U. . 

35. „ 



36. 

37. 

38. 




Name 
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DIVERGENT PRODUCTION OF CLASSES 



See how many different categories you can make in thirty minutes using the 
words you wrote about the topic, ”law”. Each category you think of should be 
written in one of the boxes below. Each category you write should have at least 
one word from your oven list or from the list on the board, but you may use 
v^ords not on the list if you need them to make good categories. You do not have 
to write the heading for your category, but you may do so if you wish. You may 
use a word in as many categories as you wish, but try to make as many different 
categories as you can, that is, try to have categories based on a variety of 
characteristics • 
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CONVERGENT PRODUCTION OF CLASSES - MATCHING 

Complete the cAtei^orles started in the boxes by picking out the word from the 
list at the left which best fits the other two. Write the word in the box. 

Use each word from the list only once. We will work the first item together, 
then see how many of the items you can complete in the time allowed. 



ITEM 2. 



LEVINWORTH 
MR. RICHELIEU 
PERRY MASON 
STAGECOACH 



ALCATRAZ 
SAN QUENTIN 



J. EDGAR HOOVER 
CHIEF JUSTICE WARREN 



HONEY WEST 
MAN FROM U.N.C.L.E. 



MARSHALL DILLON 
WYATT EARP 



ITEM 3« 



ARSON 


BRASS KNUCKLES 




GLOVES 




MAYOR 


DELINQTJENT 


GUN 




SHOES 




PRINCIPAL 


FATHER 













HELMET 



PRECINCT 


DISTRICT 




MURDER 






JUVENILE HALL 


SWITCHBLADE 


CITY 




ROBBERY 






JUVENILE COURT 



ITEM ii. 

BURGLER ALARM 

ELECTORATE 

HANDCUFF 

OPERATIVE 

STOCKADE 

SUCCESSION 




PRISON 




SIREN 




ELECTION 


JAIL 




HHISTIf 




APPOINTMENT 



VOTERS 

CONSTITUENTS 




NIGHT STICK 
GUN 
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CONVERGENT PRODUCTION OF CLASSES - MATCHING 



Complete the categories started in the boxes by picking out the word from the 
list at the left which best fits the other two* Write the word in the box* 
Use each word from the list only once* Complete as many as you can in the 
time allcwed* 






ITEM 5* 

CHARQS 

GUILTY 

REASON 

VINDICATE 











EXONER/ITE 




ACCUSE 




ACQUIT 




INDICT 


0 








1 

i' • 



JUSTIFY 




IHCRININATE 


EXCUSE 




CONVICT 

- 1 



ITEM 6. 

CIVILIAN 

GANGSTER 

OFFICIAL 

SOLDIER 



ITEM 7* 

BRIBERY 

MURDER 

SLAVERY 

VANDALISM 



DESERTION 

INSUBORDINATION 



II 




f 



TAX EVASION 
SPEEDING 




COUNTERFEITING 

SMUGGLING 










HOMOCIDE 




ARSON 


NANSUUGHTER 




HIEAKING AND ENTERINC 






ASSAULT 




GRAFT ' 


KIDNAP 




EMBEZZLEMENT 



f) 



i; ft 
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CONVERGENT PRODUCTION OF CLASSES - SAME WORD 



Most %rords can be put laito several different categories ehen we think of 
different ways in which they are used or when we group then with other words 
which share a common attribute. In the items below, a word is used to begin 
each of several different categories. In the sample item, #8, two words have 
been added to the word policeman in each column to give us a clue as to the 
category that has been started. Oar Job is to pick out from the list at the 
left additional words to write in each box. When we have done the sample item 
together, see whether you can do the same thing in items 9 and 10. 



ITEM 8. 



COP 

CORONER 

DOORMAN 

MTTPQP 

PUINCLOTHESMAN 

POSTMAN 

TEACHER 

TELEPHONE OPERATOR 



POLICEMAN 

SHERIFF 

MARSHALL 


POUCEHMI 
)ESK SEROEAHT 
STEKOQIUniER 


POLICEMAN 
cm ENGINEER 
FIREMAN 


POLICEMAN 
AIRLINE H06TES 3 
SAILOR 



ITEM 9. 



BAILIFF 

BIBLE 

COURT 

COURT REPORTER 

DECIDE 

DEPENDENT 

DELIBERATE 

EYE WITNESS 

JURY BOX 

MAGISTRATE 

TJPTfiH 

WITNESS STAND 



JUDG£ 

FUG 



JUDGE 

JURY 



JUDCE 

EVALUATE 



JUDCffi 
HIS HONOR 



I 



ITEM 10. 



AUTHORIZE 

COMMAND 

CONTROL 

DELEGATED 

ENTITLED 

KING 

KNOWLEDGE 

PRESIDENT 

PROFESSOR 

SPECIALIST 

VESTED 



AUTHORITY 


AUPHORm 


AUTHORITY 


EXPERT 


POWER 


PERMISSION 
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COirVERGENT PRODUCTION OF CLASSES - LIST DIVISION 



Divide the list at the left into two categories by writing the words in the 
app^'opriate box* We will work the first one together ^ then see how many 
of the items you can complete in the time allowed* 



ITEFx 12* 

ASSEMBLY 

BRCWN 

CONGRESS 

JOHNSON 

LEGAL VOTING AGE 
MEDICARE 
SACRAMENTO 
WASHINGTON D.C. 




Category II 



ITEM 13. 



CLUE 

SUMMONS 

FINGERPRINT 

INTSROGATE 

WARRANT 

TICKET 

LIE DETECTOR 
SUBPOENA 




Category II 



ITEM Ih. 




ARRESTED 

BAIL 

BOOKED 

CONVICTED 

IMPRISONED 

PARDONED 

PAROLED 

PROBATION 




' ■ 
CategoiT II 



Divide the list at the left into three categories by writing the words in the 
appropriate box* 




CRIMINAL 

CROOK 

COURT MARTIAL 

DEPUTY 

FucmvE 

HEARING 

MARSHALL 

POLICEMAN 

TRIAL 



Category I 



Category II 



Category III 



ITEM 16, 






WARDEN 

ATTORNEY 

COUNSELOR 

D.A. 

FATHER 

GOD 

GUARD 

JAILER 

KEEPER 

LAWYER 

MAYOR 

PRESIDENT 



j 



j 



ITEM 17* 



"C” CARD 
DRAFTED 
ENTITLED 
FINE 

! IMPRISONED 
LICENSE 
ORDERED 
J PASSPORT 
I PERMITTED 
PUNISHED 
SUBPOENA 
SUMMONS 






Category I 



Category II 



Category III 
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CONVERGENT PRODUCTION OF CLASSES - CROSS WORD 



The three Items below are like cross word puzzles In which you work with 
meanings of words rather than with letters* The words at the left can be 
written in the boxes so that the words in each row form categories and the 
words in each column form different categories* In this way we can make six 
categories from the nine words. We will work the first one together* When 
you understand how it is done^ see if you can work out the other two puzzles 
by figuring out which word to write in each box* 



ITEM 18* 



DEMCCRACY 

DICTATORSHIP 

LONDON 

MONARCHY 

MOSCOW 

PREMIER 

PRESIDENT 

QUEEN 

WASHINGTON D*C* 




ITEM 19* 



ARMED FORCES 
HIGHWAY PATROL 
HORSE 
JEEP 

MILITARY POLICE 

MOTCRCYCLE 

MOUNTED POLICE 

NATION 

STATE 




ITEM 20* 



EXECUTIVE 
ENFGRCE UWS 
CONGRESS 
JUDICIAL 
HEAR CASES 
LEGISUTIVE 
PASS LAWS 
PRESIDENT 
SUPREME COURT 




o 
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MEMORY OF CLASSES 



ITEM 11. We will work this item together. Pick out from emong the words in 
the list the five words which you think will Hike the best headings under which 
to cafcegoriae other words in the list. Write each heading-word you decide on 
at the top of one of the squares below. Now, write each of the other words 
from the list in the square with the appropriate heading. Use each word only once. 



ARREST 

ATTORNEY 

CONGRESS 

CORRECTION 

COURT 

DETECTION 

ENFORCEMENT 

FINE 

FINGERPRINT 

GUN 

HIGHWAY PATROL 

INVESTIGATOR 

JUDGE 



JUDICIAL SYSTEM 

LEGISUTICW 

LIE DETECTOR 

MEDICARE 

POLICEMAN 

PAROLE 

PRISON 

PROBATION 

SENATOR 

STATUTE 

SURVEILANCE 

TRIAL 
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COONITIOH OP CUSSES DELETION 



NAME 

EXAMPLE: 

JAIL 

MURDER 

PRISON 

STOCKADE 



INSTRUCTIONS : You are to make the best 
possible category or class of words by 
removing the one word you consider inap- 
propriate from each item* Circle the 
one word in each item that does not belong. 



(1) 


AMBUUNCE 
GET-AWAY CAR 
MOTORCYCLE 
SQUAD CAR 


(10) 


DEPUTY 

HIGHWAY PATROLMAN 

MARSHALL 

SHERIFF 


(19) 


JUDGE 

JURY 

UWYER 

MAYOR 


(8) 


oirruw 

BANDIT 

IN-UW 

CRIMBIAL 


(11) 


IMPRISONMENT 

FINE 

GALLOWS 

ELECTRIC CHAIR 


(20) 


BADoac 

BILLYCLUB 

GUN 

TEAR GAS 


(3) 


BILLYCLUB 

BUCK-JACK 

PISTOL 

WHISTLE 


(1?) 


MURDER 

RIOT 

ROBBERY 

SHOPLIFTING 


(21) 


CHIEF JUSTICE 
CHIEF OF POLICE 
JUDGE 

JUSTICE OF THE PEACE 


(U) 


KING 

PEOPLE 

PRESIDENT 

PRINCIPAL 


(13) 


MARSHALL 

POLICEMAN 

JUDGE 

DEPUTY 


(2?) 


BEATNIK 

KIDNAPPER 

PICKPOCKET 

VANDAL 


(5) 


DETECTIVE 

P *B.I. 

UWYER 

POLICEMAN 


(111) 


ABIDE BY 
UWS 
ORDERS 
RULES 


(23) 


JAIL 

CELL 

PRISON 

PENITENTIARY 


(6) 


BILL OF RIGHTS 

CONSTITUTION 

LINCOLN 

EMANCIPATICM-PROCUMATION 


(15) 


OPERATIVE 
SECRET AGENT 
SPY 

ELUDOT NESS 


(2U) 


GOVERN 

JUDCS 

REIGN 

RULE 


(7) 


ARREST 
PINGERPRINT 
INTERROGATE 
LIE DETECTOR 


(16) 


HONEST 

LEGAL 

OBEY 

LEGITIMATE 


(25) 


CROSSWALK 
JAYWALK 
STOP SIGN 
TRAFFIC LIGHT 


(8) 


CONGRESS 
GOVERNOR 
PRESIDENT 
SUPREME COURT 


(17) 


AMENDMENT 
BILL OF RIGHTS 

UW 

STATUTE 


(26) 


SENATE 

VICE PRESIDENT 

GOVERNMENT 

CONGRESS 


(9) 


DEPENDENT 
DISTRICT ATTORNEY 
JUDGE 
POLICEMAN 


(18) 


CONGRESSMAN 

JUDGE 

REPRESENTATIVE 

SENATOR 


(27) 


RADIO 
SIREN 
SPOTLIGHT 
STOP SIGN 



o 
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COGNITION OF CLASSES 



PICK - A - HEADING 



In tach Itam thara ara four words. Saa if you can pick out ona word which 
makas tha bast haadina for tha catagory formad by the remaining thraa words. Circle 
the word you have chosen as the best "haadlng-word** . 

PICK - A - HEADING 



1. 


BADGE 


11. 


LYNCH MOB 




BOOTS 




SHERIFF 




HELMET 




STAGECOACH 




UNITORM 




WESTERNS 


2. 


JOHNSON 


12. 


CASE 




LINCOLN 




EVIDENCE 




PRESIDENT 




TRIAL 




WASHINGTON 




VERDICT 


3. 


CAPITAL CRIME 


13. 


BOBBY 




KIDNAPPING 




BRITAIN 




MURDER 




PARLIAMENT 




TREASON 




PRIME MINISTER 




DEPENDEWT 


lU. 


CON(»ESSMAN 




JUDGE 




ELECTED 




JURY 




MAYOR 




TRIAL 




PRESIDENT 


s. 


CROSSWALK 


15. 


JUVENILE COURT 




SPEED LIMIT 




JUVENILE DELINQUENT 




STOP LIGHT 




JUVENILE HALL 




TRAFFIC LAWS 




REFORM SCHOOL 


6. 


FINE 


16. 


ELECTROCOTE 




HARD LABOR 




EXECUTE 




PRISON 




GAS 




PUNISHMENT 




HANG 


7. 


BULL 


17. 


F.B.I. 




COP 




SUPREME COURT 




FUZZ 




WHITE HOUSE 




POLICEMAN 




WASHINGTON D.C. 


8. 


EXBCOTIVE 


18. 


ASSEMBLYMAN 




PRESIDENT 




LEGISLATOR 




SECRETARY OF DEFENSE 




REPRESENTATIVE 




VICE PRESIDENT 




SENATOR 


9. 


PICKING POCKETS 


19. 


LOCKS 




ROBBERY 




PREVENTION 




SPEEDIRO 




SIGNS 




UNLAWFUL 




STOP LIGHTS 


10. 


BANK ROBBER 


20. 


ACCUSED 




CRIMINAL 




CHARGED 




MURDERER 




DEFENDENT 




THIEF 




SUSPECT 
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COCWITION OF CLASSES 



(28) INDICTMENT 
SUMMONS 
TICKET 
V7ARRANT 

(29) KING 
LORD 

PRIIC MHIISTER 
SENATOR 

(30) GRAfID THEFT 
PICKPOCKET 
SHOPLIFTING 
VANDALISM 

(31) CHIEF JUSTICE 
JUDICIAL BRANCH 
JUDGE 

JTJSTICE OF THE PEACE 

(32) CASE 
COURT 
HEARING 
TRIAL 

(33) GOVERNOR 
CHIEF JUSTICE 
MAJOR 
PRESIDENT 

(3U) INTERPRETATION 
LAVJ 
RULE 
STATUTE 

(3^) APPOINT 
ELECT 
POlrJER 
SEIZE 

(36) ENFORCE 
DTTERPRET 
LEGISUTE 
ORDER 

(37) CAPITOL 
KREMLIN 
MT. VERNON 
WIITE HOUSE ■ 

(38) EXECUTIVE 
GOVERNMEITT 
JUDICIAL 
LEGISUTIVE 



(39) CRIME 

INVESTIGATION 

PREVENTION 

PUNISHMENT 

(UO) POLICEMAN 
PRINCIPAL 
SUPERINTENDENT 
TEACHER 

(Ul) HIGHV/AY PATROLMAN 
PUINCLOTHESMAN 
POLICEMAN 
PRIVATE DETECTIVE 

(U2) CROOK 
ROBBER 
STEAL 
THIEF 

(U3) REGUUTIONS 
RI®TS 
RULES 

RESTRICTIONS 

(UU) ANARCHY 
DEMOCRACY 
COMMUNISM 
TYRANNY 

(U5) CHIEF OF POLICE 
FIRE CHIEF 
GOVERJIOR 

MAYOR 

(U6) ALIBI 
FALSIFY 
LIE 

PERJURY 

(U7) EX -CONVICT 
FUGITIVE 
PAROLEE 
PRISONER 

(U8) FREEDOM 

GOVERNMENT 

JUSTICE 

LIBERTY 

(U9) IDEA 

PRINCIPLE 

THEORY 

VERDICT 



(50) 

(51) 

(52) 

(53) 
(5U) 

(55) 

(56) 

(57) 

(58) 

(59) 

( 60 ) 



GRAVITATIONAL LAW 
COJISTITUTIONAL LAW 
NATURAL LAW 
SCIENTIFIC LAl‘J 

AGADJST THE UW 
ILLEGAL 
SINFUL 
UNLAVJFUL 

COURT FEES 
FINE 
RANSOM 
TICKET 

DISHONEST 

DISLOYAL 

ILLEGAL 

UNTRUTHFUL 

ABIDE BY 
OBEY 
RULE 
UPHOLD 

DELIBERATE 

EXAMINE 

HEAR 

VERDICT 

SPEED LIMIT 
STOP SIGN 
TICKET 

TRAFFIC LIGHT 

EIECT 

APPOINT 

IMPEACH 

SUCCEED 

CONSTITUENTS 

ELECTORATE 

NOMINEE 

VOTERS 

ACCUSATION 

SUMMONS 

SUBPOENA 

WARRANT 

AWARD 

DELIBERATE 

JUDGMENT 

SENTENCE 



1 
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EVALUATION OF CLASSES 



INSTRUCTIONS: In these items, three words that form a categorj have J^rouped 

tocether. To the right of each category there are two other words, mailed (A) »nd (B). 
Tour task is to decide which of these two alternatives fits best with the other three 
words in the categoty. When you have decided, tell the interviewer. He will mark 
your answer sheet and will write down your reason for picking the word you did. 



EXAMPLE 



A DOZEN EGGS 

A RULER 
A YEAR 


(A) A JUDGE 

(B) A JURY 






LAWYER 

JtJDGE 

BAILIFF 


(A) COURT REPORTER 

(B) JURY BCMC 


12. BILL OF RIGHTS 
FEDERAL LAW 
21et AMENDMENT 


(A) CONSTITUTION 

(B) ORDINANCE 


GUN 

KNIFE 

SVJITCHBLADE 


(A) BILLYCLUB 

(B) BRASS KNUCKLES 


13. SUMMONS 
TICKET 
WARRANT 


(A) INDICTMENT 

(B) SUBPOENA 


PRESIDENT 
PRIME MINISTER 
PREMIER 


(A) SENATOR 

(B) KING 


lU. HANDCUFT 
WHISTLE 
HOLSTER 


(A) UNIFORM 

(B) BILLYCLUB 


CITY HALL 
POLICE STATION 
FIRE STATION 


(A) STATE CAPITOL 

(B) COURTHOUSE 


15. KILLING 
MURDER 
ASSASSINATE 


(A) HOMOCIDE 

(B) GRAND LARCENY 


JUSTICE 

PEACE 

LIBERTY 


(A) TRUTH 

(B) FREEDOM OF - 

SPEECH 


16. GUARDIAN 
COUNSELOR 
PARENT 


(A) TEACHER 

(B) SUPERINTENDENT 


PRESIDENT 
SENATOR 
CHIEF JUSTICE 


(A) SECRETARY OF - 

DEFENSE 

(B) MAYOR 


17. DETECTIVE 
PRIVATE EYE 
INSPECTOR 


(A) INVESTIGATOR 

(B) POLICEMAN 


TRAFFIC COURT (A) JUVENILE COURT 
DIVORCE COURT (B) SUPREME COURT 
SMALL CLAIMS COURT 


18. SENATE 
ASSEMBLY 
SUPERVISORS 


(A) HOUSE OF - 

REPRESENTATIVES 

(B) SUPREME COURT 


INMATE 

PRISONER 

WARDEN 


(A) CONVICT 
(6) PAROLEE 


19. JUVENILE 
MINOR 
CHILD 


(A) DELINQUENT 

(B) ADOLESCENT 


CELLS 

BARS 

EU:CTRIC FENCE 


(A) GAS CHAMBER 

(B) WALLS 


20. UW 

STATUTE 

ORDINANCE 


(A) BILL 

(B) LEGISLATE 


SUPREME COURT 
COUNTY COURT 
NIGHT COURT 


(A) TRAFFIC COURT 

(B) KANGAROO COURT 


21. ELECTRIC CHAIR 
GAS CHAMBER 
FIRING SQUAD 


(A) LYNCH 

(B) GALLOWS 


, GAVEL 
ROBE 
JURY BOX 


(A) BAILIFF 

(B) 6IBI£ 


22. LYNCH MOB 
VIGILANTES 
KU KLUX KLAN 


(A) COURT MARTIAL 

(B) KANGAROO COURT 



o 
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EVALUATION OF CLASSES 



23. 


BimPiLAR 


(A) SHOP LIFTER 


37. DEFEND 


(A)PROSECUTE 






THIEF 


(B) VAGRANT 


CROSS EXAMINE 


(B)TESTIFY 1 






PICKPOCKET 




QUESTION 


1 




• 

CM 


BAIL 


(A) ATTORNEY'S FEES 


38. MANSLAUGHTER 


(A)SUICIDE r 






COTIRT COSTS 


(B) JUDGE’S FEES 


ACCIDENTAL DEATH 


(B)HURDER 1 






FDIE 




JUSTIFIABLE HOMOCIDE ^ 




2 $. 


COURT REPORTER 


(A) TRANSCRIPT 


39. FLAG 


1 






STENOGRAPHER 


(B) TAPE RECORDER 


LIBERTY BELL 


(A)UNCLE SAM || 






SECRETARY 




EAGLE 


(B)PIfDOE OF- 










ALLEGIANCE | 




m 

CM 


MOUTHPIECE 


(A) DEFENSE ATTORNEY 




j| 






COUNSELOR 


(B) PROSECUTINO - 


UO. LOITERING 


(A) OVER-PARKING 






SOLICITOR 


ATTORNEY 


VAGRANCY 


(B)SPEEDING 


j 








DISTURBING THE PEACE 




27. 


DESERTER 


(A) WET BACK 










FirilTIVE 


(B) PRISONER 


la. REBELLION 


(A) PANIC 






OUTLAW 




INSURRECTION 


(B)RIOT I 


1 








REVOLUTION 


i| 

i( 




28. 


HOMOCIDE 


(A) MISSING PERSONS 








TRAFFIC 


(B) DEATH PENALTY 


U2. DEMOCRACY 


(A)ANARCHY 


jj 




NARCOTICS 




MONARCHY 


(B)DESPOTISM j 










DICTATORSHIP 


If 


1! 


29. 


STOP LIGHT 


(A) TRAFFIC POLICE 




j' 


1 




TRAFFIC SIGNS 


(B) SPEEDING 


U3. WARNING 


(A)DIRECTIONS 






DOUBLE YELLOW - 




REPRIMAND 


(B)CRIME L 


J 




LINE 




CITATION 


, 


i 


30. 


SUSPENDED 


(A) ARRESTED 


UU. BENCH 


(A)JUDGE ' 






REVOKED 


(B) LOST 


HIS HONOR 


(B)JURY 




EXPIRED 




COTJRT 


<1 

r 

l! 


1 


31. 


TRUANT 


(A) MINOR 


U5. EYE WITNESS 


(A)POLICE ' 1 




SAFETY PATROL 


(B) DELINQUENT 


VICTIM 


(B)SUSPECT 






CURFEW 




BYSTANDER 


f 

I 


j 


32. 


ACCUSE 


(A) LIE 


U6. ACQUIT 


(A)INDICT 






SLANDER 


(B) STEAL 


CONVICT 


(B)ESCAPE : 




CHARGE 




DISMISS 


!] 

' i 


33. 


PARDON 


(A) OUT ON BAIL 


U7. FREEDOM OF SPEECH 


(A)THE RIGHT TO BEAR 


r 




PAROLE 


(B) SUSPENDED - 


FREEDOM OF RELIGION ARMS i 


i! 




PROBATION 


SENTENCE 


FREEDOM OF - 


(B)FREEDOM FROM FEAR^ 


J 








ASSEMBLY 


1 




3U. 


BOOKED 


(A) CONVICTED 




]■ 

'r 






ARRESTED 


(B) ACCUSED 


U8. SOLITARY CONFINEMENT (A)PRISON 






INDICTED 




BREAD AND WATER 


(B) CHAIN GANG 








HARD LABOR 


j 


!! 

ll 


35. 


DEPENDENT 


(A) PRISONER 




' 5 
!' '' 




ACCUSED 


(B) PUINTIFT 


U9. LAW OF GRAVITY 


(A)LAW OF THE LAND 




SUSPECT 




LAW OF GOD 


(B)LAW OF NATURE 


'1 








LAW OF SUPPLY AND 


DEMAND 


1! 

1 


36. 


ACCUSATION 


(A) CHARGE 






j 




INDICTMENT 


(B) SUSPICION 


50. PROPERTY DAMAGE 


(A)STEALING A CAR , 




ALIJEGATTON 




DIVORCE 


(B)ACCIDENTAL INJURY. 


■» 1 








NON-PAYMENT OF - 


TO A PASSENGER IN^ 










DEBTS 


YOUR CAR 


k ERIC 
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ANSWER SHEET FOR EVALUATION OF CLASSES 

Interviewer*! Name 



Item Answer 

No. A or B 



Rationale 





— ^ 
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DIVEROENT PRODiJCTION OF :jNtT<; SCORING MAIIUAL 
SUB- [ 

ITEOORY SCORE CATEGORY SCORE EX AMPLES I 1 

n ir-5 ■ 

T. Hlph ItTel abstractions# Human conditions dependent upon law# democracy, justice , j j 

truth, freedom , equality, duty, independence, peace , | 

safety, security, authority, life, government 



II# Forms, definittons, purposes 

A, Abstract terms indicating what laws pertain to: statutes, ■ 

rules, principles, regulations, orders, requirements, 
restrictions, prohibitions, obligations, duties, safe-guards, 
protection , privileges, righto, guides, governmental 
rules, co^es 

Abstract terms indicating a positive relationship between 
individual and the law: defend, abide by , follow, law j 

abiding, lawful, legitimate, defend, observe, help, agreeafc p, 
honest, need for law, loyal, laws that I have, right 



C, Abstract terms indicating a negative relationship between i ^ 

individual and the laew: bad, break , crime , criminal , 

disobey , discipline, lie, punishment , trouble , violation , j | 
wrong , against, dislike, hurt, harm, illegal, injury, mean^; | 
meanness, not nice, offenses, terrible, unhappy, unagreeable*, 
unjust, unlawful, can’t do, won't allow, treat us like babi“s, 
outlaw, convict, fugitive, delinquent j j 

^ 

ITT# Enumeration of legal documents or specific laws ^ 

. A# Man-made - general ; j 

Constitution , amendments , Bill of Rights, state laws , , j 

law of the land, federal law , law, county, town, city 

' communities, school rules , maritime law. Articles : | 

of Confederation, preamble, misdemeanor, nations, states, 
people 

ij 

B, Natural, divine, or scientific j 

law of force, learning laws. Golden Rule, religion, church, 1 
supreme law, science, mathematics, gravity 

^ : i 

C# target groups or activities 

labor union laws, leash laws, transportation laws, right 
to vote, driving laws, tariff, divorce, taxes, business, 
children, old people, poor, child labor, women, young 
' people, alcohol, license, voting, Americans, people, students 



► 



► 






o 

L ERLC 



D# 




Crime and criminals indicating a knowledge of what is iliep 1 
robbery, killing, steal, riot , murder , kidnap , speeding , ! 
hold**up, mob, smug*gier, thief, treason, contributing to 
the delinquency of a minor, assault, battery, bandit, 
breaking into houses, burglery, drunkeness, hit and run, 
helping foreign agents, leaving country without passport, 
manslaughter, rob a bank, slander, stow-away, knife, heroin > 

Laws and regulations concerning youthful offenders and J 

offenses- 

cheating, be in by 12, bicycle, curfew, crashing parties, ; 
can't drive until 16, can't stand in corridors, ditching, ! Jj 
don't write on desks, dog on school grounds J 
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.OORY SCORE CATEGORY SCORE 
• Pertaining to legislation 



Z Pertaining to government, 

A • 



DEFINITIONS AND EXAMPLES 



Congress, legislative, representative , senate, law waking , 
bill, senator, house, house of representatives, council, 
congressman, election, how a bill becomes a law, politics, 
party, republican, running, city hall , capitol 



Executive branch and seats of power. 

United States : 

president , executive, cabinet, capitol, governor, vice 
president, mayor, state department, Washington D,C., 
White House 



^ Presidents by name: Kennedy, Johnson, Truman, Lincoln 

Free associations: Gettysburg Address, Arlington 

Cemetery, Tomb of the Unknown Soldier 

5, Other forms of government: Communism, dictatorship, 

ruler, Musolini, Hitler, Panzer Division, Rommel, Third Reich 

E7 War - Defense department and Armed Forces 

war, Viet Nam, Coast Guard, marine police. Pentagon, 

Shore Patrol, Commander in Chief of the Armed Forces, 

General, George Patton, Pearl Harbor 

p 7 Non-governmental persons in authority 

father, mother, principal, teacher, and specified persons 



VI, Pertaining to enforcement. 

Abstractions: enforcement , enforce, detection, correction, 

apprehension, investigation, confinement, penalities 

Institutions : police force, police department, juvenile 

hall, highway patrol , F.B.I. , Scotland Yard, traffic court, 
police station , C^.iTa. 

C, ~ Officers: police , policeman , sheriff , det^tives , deputies , 

officer, reinf orcements , cop, marshall, sergeant, fuzz, 

Elliot Ness, J .Edgar Hoover, juvenile authorities, patrol, 
lieutenant, probation officer, Sherlock Holmes, investigator, 
agent 

D , Equipment : uniform , gun , siren , badge , car , motorcycle , 

police car, signs, stop sign, ambulance, handcuff, police 
dog, lights, radar, radio, signal, telephone, billy-club, 
lie detector, police hat, stop light, tape recorder 

E, Processes: ticket, arrest, bail, chase, fingerprint, 

booked, captured, citation, license mmber, road block, 
summons, shoot, clues 

P7 Correction and penalities: Jail , prison , fine, electric 

chair, gas chamber, probation, bars, ceils, death, death 
penalty, hang, hard labor, San Quentin, warden, jail break, 
convict, ex-convict, fugitive 



o 
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mnOKt 8C0RE CATEGORY SCORE 



DEFINITIONS AND EXAi^PLES 



VII* Ftrialninfc to judicial aystem* 

Abstractions: justice, judicial , interpretation, bench, 

interpret, jurisdiction 



i: 



People; Aucige , jury , lawyer , witness , attorney, defenden» , 
accused. Perry Mason, prosecutor, defense attorney, i I 
Chief Justice, counselor, client, district attorney, 
justice of the peace, supreme justice, spectators, bailiff 



r» 


Processes : 

trial, defend, decision, subpoena, case, defense, oath, 
sue, testify, question, evidence 




Institutions : 




court. Supreme Court, Court of Appeals, District Court, 
Traffic Court, courtroom, court house 

i) 




Verdict; verdict, convict, conviction, guilty, not guilty 
innocent, sentence | 



VIII. Pertaining to law as a profession, 

A* Abstractions; field of law, profession 

B* Specific; lawyer , attorney , law practice , law book, 

law suit, law school, books, case, client, classes, i j 

collej^e, college years. Harvard, Yale, law firm, law | ] 

office, law study, law academy, legal secretary, learning, 
office, private school, sue, study, understanding the laW^ I 

. i j 

c. Miscellaneous; teacher, doctor 



IX. Other. . woney , accident 



r 




f 

ji 



■1 

!i 

! 
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TABLE 8 

THE PLACEMENT BY 3TANINES OP THE PIPTY-POUR SUB.7ECTS ON IQ, GRADE 
POINT AVERAGE AND SIX TASKS DESIGNED POR THE STUDY 



mi' SEX 


(1) (2) (3) (U) (5) (6) (7) (8) 

TIQ GPA D?f DPC CPC MEM COO EVAL 


10 


Y 


1 


3 


6 


h 


3 


U 


U 


6 


12 


X 


9 


6 


5 


6 


5 


U 


5 


6 


13 


X 


2 


9 


9 


7 


7 


5 


6 


$ 


lU 


y 


6 


U 


3 


U 


5 


U 


3 


5 




Y 


5 


5 




3 


2 


5 


5 


U 


16 


X 


6 


3 


i 


7 


u 


6 


U 


U 


17 


X 


6 


U 


h 


6 


3 


2 


5 


2 


13 


Y 


3 


U 


h 


1 


2 


7 


5 


3 


19 


X 


3 


6 


h 


U 


9 


U 


5 


8 


20 


X 


3 


U 


2 


1 


U 


U 


7 


5 


21 


X 


3 


3 


5 


U 


6 


5 


3 


3 


22 


X 


3 


2 


2 


2 


6 


3 


2 


1 


23 


X 


5 


7 


u 


5 


U 


7 


8 


7 


2U 


Y 


6 


9 


8 


6 


7 


7 


U 


3 


25 


Y 


6 


6 


8 


3 


6 


6 


7 


8 


26 


Y 


6 


3 


3 


9 


1 


3 


2 


5 


27 


Y 


7 


9 


6 


9 


U 


7 




3 


2% 


X 


6 


6 


6 


h 


8 


6 


6 


5 


29 


X 


2 


2 


7 


6 


3 


U 


2 


5 


30 


Y 


7 


2 


h 


3 


U 


7 


8 


6 


31 


X 


3 


h 


7 


5 


6 


5 


6 


2 


33 


X 


h 


3 


5 


7 


2 


5 


U 


u 


3ii 


X 


2 


U 


1 


2 


5 


5 


1 


3 


35 


X 


2 


7 


7 


8 


3 


6 


U 


U 


36 


X 


U 


3 


3 


5 


7 


U 


8 


u 


37 


X 


7 


7 


6 


8 


5 


5 


5 


6 


38 


X 


6 


6 


5 


5 


3 


3 


2 


6 



(1) CTMM m 

(2) Grade Point Averaj?e 

(3) Divergent Production of Uhite 
Total Number of Words 

(U) Divergent Production of Classes 
Number of Classes 



o 
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(1) (2) (3) (U) (5) (6) (7) (8) 
m# SEX TW GPA DPU DPC CPt MEM COG EVAL 



39 X 56335566 
UOT575U9666 
lilYU65U2 Ul6 
U2 Y8526887U 
U3 Y996U8999 
liltY78867775 
U5XUU5662U7 
U6 xU5682US5 
U7XU1325132 
U8Y31UUU267 
U9XU65652U1 
51Y77676137 
52Y5U3U3U77 
53 X55561632 

SUY98777866 
55Y88S7h77U 
56Y76S37968 

58YU31U53U3 

59 X 3 5 5UU877 

60 X 1 5 U 3 7 5 3 

61Y76736535 
63Y53665736 
65 X 3 7 6 7 U77U 

67Y7289U32U 
69Y55796U5U 
71 X55986768 

73YUU236U58 



(5) Contrsrgent Production of Clssaes 
List Division 

(6) Memory of Classes 

(7) Cognition of Classes 

(8) Evaluation of Classes 



